2024-09-16T07:28:45.453 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T07:28:45.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:28:45.549 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} email: null first_in_suite: false job_id: '7906867' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: bluestore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 6651 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSupPkO5uBzRNu2N65pBZTPo2M0JljQzXlAk5hAihF7Htue2+y+2r/6gM9v+58tE7/MYTwke73z7qI2rzpWP7I= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHGydHGsAZEXB6RSBQfBUAdTKZJNJDnWQqWCywleM6A20yKvTdRk+Z8A0uXFd0FKaroD0jtLNyZPesTI7CgG0I= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 - radosbench: clients: - client.0 concurrency: 128 size: 8192 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_07:15:55 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T07:28:45.549 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-16T07:28:45.550 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-16T07:28:45.551 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T07:28:45.553 INFO:teuthology.task.internal:Checking packages... 2024-09-16T07:28:45.574 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-16T07:28:45.574 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T07:28:45.574 INFO:teuthology.packaging:ref: None 2024-09-16T07:28:45.574 INFO:teuthology.packaging:tag: None 2024-09-16T07:28:45.574 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-16T07:28:45.574 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:28:45.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-16T07:28:45.721 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-16T07:28:45.723 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T07:28:45.729 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T07:28:45.729 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T07:28:45.751 INFO:teuthology.task.internal:Saving configuration 2024-09-16T07:28:45.768 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T07:28:45.775 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T07:28:45.799 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:23:51.985570', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSupPkO5uBzRNu2N65pBZTPo2M0JljQzXlAk5hAihF7Htue2+y+2r/6gM9v+58tE7/MYTwke73z7qI2rzpWP7I='} 2024-09-16T07:28:45.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 07:23:51.983661', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHGydHGsAZEXB6RSBQfBUAdTKZJNJDnWQqWCywleM6A20yKvTdRk+Z8A0uXFd0FKaroD0jtLNyZPesTI7CgG0I='} 2024-09-16T07:28:45.817 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T07:28:45.823 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-16T07:28:45.823 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-16T07:28:45.823 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T07:28:45.910 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f78d4e23be0>, signals=[15]) 2024-09-16T07:28:45.910 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T07:28:45.916 INFO:teuthology.task.internal:Opening connections... 2024-09-16T07:28:45.916 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T07:28:45.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:28:46.012 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-09-16T07:28:46.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:28:46.097 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T07:28:46.104 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-09-16T07:28:46.122 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-09-16T07:28:46.122 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-09-16T07:28:46.180 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-09-16T07:28:46.180 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-09-16T07:28:46.180 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-09-16T07:28:46.180 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T07:28:46.181 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T07:28:46.182 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-09-16T07:28:46.206 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-09-16T07:28:46.224 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-09-16T07:28:46.225 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-09-16T07:28:46.283 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-09-16T07:28:46.283 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-09-16T07:28:46.283 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-09-16T07:28:46.283 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T07:28:46.284 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T07:28:46.285 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-09-16T07:28:46.304 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T07:28:46.313 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T07:28:46.351 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T07:28:46.351 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:28:46.354 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-09-16T07:28:46.371 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T07:28:46.378 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T07:28:46.379 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:28:46.413 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-09-16T07:28:46.438 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T07:28:46.483 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T07:28:46.498 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-16T07:28:46.498 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-16T07:28:46.498 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:28:46.499 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T07:28:46.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:28:46.516 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-16T07:28:46.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:28:46.517 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-16T07:28:46.574 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-503.el9.x86_64 2024-09-16T07:28:46.574 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-503.el9.x86_64 2024-09-16T07:28:46.574 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-09-16T07:28:46.575 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-503.el9.x86_64 2024-09-16T07:28:46.576 INFO:teuthology.task.kernel:Running kernel on smithi137: 5.14.0-503.el9.x86_64 2024-09-16T07:28:46.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum install -y kernel 2024-09-16T07:28:49.223 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.2 MB 00:00 2024-09-16T07:28:49.252 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.2 MB 00:00 2024-09-16T07:28:50.962 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-16T07:28:56.279 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.5 MB 00:01 2024-09-16T07:28:57.721 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-16T07:28:58.742 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-16T07:29:04.164 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T07:29:06.179 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T07:29:06.179 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T07:29:06.258 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T07:29:06.263 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T07:29:06.264 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:29:06.264 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:29:06.264 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:29:06.264 INFO:teuthology.orchestra.run.smithi137.stdout:Install 4 Packages 2024-09-16T07:29:06.264 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:29:06.264 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 79 M 2024-09-16T07:29:06.265 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 126 M 2024-09-16T07:29:06.265 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:29:06.441 INFO:teuthology.orchestra.run.smithi137.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 174 kB/s | 23 kB 00:00 2024-09-16T07:29:06.691 INFO:teuthology.orchestra.run.smithi137.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-16T07:29:06.772 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:16 2024-09-16T07:29:07.391 INFO:teuthology.orchestra.run.smithi137.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 30 MB/s | 29 MB 00:00 2024-09-16T07:29:07.875 INFO:teuthology.orchestra.run.smithi137.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 22 MB/s | 35 MB 00:01 2024-09-16T07:29:07.875 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:29:07.875 INFO:teuthology.orchestra.run.smithi137.stdout:Total 49 MB/s | 79 MB 00:01 2024-09-16T07:29:08.558 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:29:08.905 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:29:08.905 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:29:09.879 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:29:09.880 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:29:11.006 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-16T07:29:12.323 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:29:12.532 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-16T07:29:12.974 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:29:13.067 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:29:13.452 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-16T07:29:15.875 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:29:16.002 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:29:18.936 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T07:29:20.822 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:29:20.860 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:29:21.015 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T07:29:21.015 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T07:29:21.105 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:29:21.117 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:29:21.117 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-16T07:29:21.117 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:29:21.118 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 79 M 2024-09-16T07:29:21.119 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 126 M 2024-09-16T07:29:21.119 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:29:21.252 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 258 kB/s | 23 kB 00:00 2024-09-16T07:29:24.760 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 8.1 MB/s | 29 MB 00:03 2024-09-16T07:29:25.319 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-16T07:29:25.696 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:29:27.252 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.7 MB/s | 35 MB 00:06 2024-09-16T07:29:27.252 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:29:27.252 INFO:teuthology.orchestra.run.smithi170.stdout:Total 13 MB/s | 79 MB 00:06 2024-09-16T07:29:27.942 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:29:28.287 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:29:28.287 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:29:29.230 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:29:29.231 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:29:31.678 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:29:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:29:32.403 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:29:35.187 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:29:35.316 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:29:40.135 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:29:40.241 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:29:45.099 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:03.972 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:04.012 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:04.343 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:04.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:30:04.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:30:04.343 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:30:05.241 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:05.242 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:30:05.242 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:30:05.242 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:05.242 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T07:30:05.242 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T07:30:05.242 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T07:30:05.242 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:30:05.242 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:30:05.611 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:30:05.687 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:05.688 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:30:05.688 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T07:30:05.688 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T07:30:05.688 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T07:30:05.688 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T07:30:05.689 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T07:30:05.689 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:30:05.746 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:05.747 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:30:05.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-09-16T07:30:05.781 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.06 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 82.el9 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Group : Unspecified 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 8274670 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T07:30:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : builder@centos.org 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:30:05.783 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T07:30:05.784 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T07:30:05.784 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 5.14.0-505.el9.x86_64 2024-09-16T07:30:05.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T07:30:06.472 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-09-16T07:30:07.864 INFO:teuthology.orchestra.run.smithi137.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T07:30:07.885 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-09-16T07:30:07.887 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-16T07:30:07.902 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.O73CJzVJnB 2024-09-16T07:30:07.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.O73CJzVJnB 2024-09-16T07:30:07.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.O73CJzVJnB 2024-09-16T07:30:08.120 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.O73CJzVJnB is 6KB 2024-09-16T07:30:08.141 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.O73CJzVJnB 2024-09-16T07:30:08.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T07:30:08.219 INFO:teuthology.orchestra.run.smithi137.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T07:30:08.219 INFO:teuthology.orchestra.run.smithi137.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T07:30:08.219 INFO:teuthology.orchestra.run.smithi137.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T07:30:08.219 INFO:teuthology.orchestra.run.smithi137.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T07:30:08.221 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T07:30:08.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-09-16T07:30:23.508 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:23.546 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:23.917 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:23.917 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T07:30:23.917 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T07:30:23.917 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T07:30:24.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T07:30:24.807 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:30:24.807 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:30:24.808 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:24.808 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T07:30:24.808 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T07:30:24.808 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T07:30:24.808 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:30:24.808 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:30:25.162 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:30:25.254 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:25.255 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:30:25.255 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T07:30:25.255 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T07:30:25.255 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T07:30:25.255 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-16T07:30:25.255 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T07:30:25.256 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T07:30:25.314 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T07:30:25.314 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T07:30:25.314 DEBUG:teuthology.orchestra.run.smithi170:> sudo rpm -qi grub2-tools 2024-09-16T07:30:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Name : grub2-tools 2024-09-16T07:30:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Epoch : 1 2024-09-16T07:30:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Version : 2.06 2024-09-16T07:30:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Release : 82.el9 2024-09-16T07:30:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: x86_64 2024-09-16T07:30:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T07:30:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Group : Unspecified 2024-09-16T07:30:25.356 INFO:teuthology.orchestra.run.smithi170.stdout:Size : 8274670 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:License : GPLv3+ 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:Packager : builder@centos.org 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:Vendor : CentOS 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:Summary : Support tools for GRUB. 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:Description : 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T07:30:25.357 INFO:teuthology.orchestra.run.smithi170.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T07:30:25.358 INFO:teuthology.orchestra.run.smithi170.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T07:30:25.358 INFO:teuthology.orchestra.run.smithi170.stdout:hardware devices. 2024-09-16T07:30:25.358 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:30:25.358 INFO:teuthology.orchestra.run.smithi170.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T07:30:25.359 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T07:30:25.359 INFO:teuthology.task.kernel:Updating grub on smithi170 to boot 5.14.0-505.el9.x86_64 2024-09-16T07:30:25.359 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T07:30:25.973 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2024-09-16T07:30:27.308 INFO:teuthology.orchestra.run.smithi170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T07:30:27.342 INFO:teuthology.orchestra.run.smithi170.stderr:done 2024-09-16T07:30:27.344 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-09-16T07:30:27.360 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.b9XBWxk4RE 2024-09-16T07:30:27.360 DEBUG:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.b9XBWxk4RE 2024-09-16T07:30:27.427 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.b9XBWxk4RE 2024-09-16T07:30:27.573 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.b9XBWxk4RE is 6KB 2024-09-16T07:30:27.623 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.b9XBWxk4RE 2024-09-16T07:30:27.638 DEBUG:teuthology.orchestra.run.smithi170:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T07:30:27.701 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T07:30:27.701 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T07:30:27.701 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T07:30:27.701 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T07:30:27.702 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T07:30:27.849 DEBUG:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2024-09-16T07:30:38.398 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T07:30:38.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T07:30:38.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:30:56.957 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-09-16T07:30:57.852 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-16T07:30:57.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-16T07:30:57.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:31:05.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T07:31:05.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:31:16.417 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-09-16T07:31:25.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-16T07:31:25.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:31:28.481 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-09-16T07:31:40.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-16T07:31:40.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:32:05.994 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T07:32:13.023 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-16T07:32:13.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-16T07:32:13.386 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-16T07:32:13.387 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-16T07:32:13.401 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-505.el9.x86_64 2024-09-16T07:32:13.402 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T07:32:13.402 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:32:13.402 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T07:32:14.403 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-16T07:32:14.403 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T07:32:14.480 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-09-16T07:32:14.502 DEBUG:teuthology.parallel:result is None 2024-09-16T07:32:17.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T07:32:17.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:32:18.434 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-16T07:32:18.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T07:32:18.779 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T07:32:18.780 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-09-16T07:32:18.796 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-505.el9.x86_64 2024-09-16T07:32:18.797 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T07:32:18.797 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T07:32:18.797 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T07:32:19.798 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T07:32:19.798 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T07:32:20.182 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-09-16T07:32:20.205 DEBUG:teuthology.parallel:result is None 2024-09-16T07:32:20.205 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T07:32:20.213 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T07:32:20.213 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:32:20.216 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T07:32:20.235 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T07:32:20.321 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T07:32:20.381 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T07:32:20.381 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:32:20.384 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T07:32:20.494 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T07:32:20.501 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T07:32:20.501 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:32:20.504 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T07:32:20.534 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:32:20.537 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:32:20.545 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:32:20.549 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T07:32:20.551 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T07:32:20.565 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T07:32:20.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:32:20.590 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T07:32:20.619 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T07:32:20.644 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T07:32:20.644 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:32:20.657 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T07:32:20.676 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:32:20.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:32:20.808 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:32:20.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:32:20.933 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:32:20.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:32:20.998 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:32:21.044 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T07:32:21.097 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:32:21.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T07:32:21.225 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:32:21.226 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T07:32:21.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-09-16T07:32:21.294 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-09-16T07:32:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:32:21.387 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:32:21.894 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T07:32:21.905 INFO:teuthology.task.internal:Starting timer... 2024-09-16T07:32:21.906 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T07:32:21.997 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T07:32:22.089 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-16T07:32:22.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-09-16T07:32:22.133 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-09-16T07:32:22.134 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-09-16T07:32:22.189 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-09-16T07:32:22.192 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T07:32:22.192 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-09-16T07:32:22.216 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-09-16T07:32:22.217 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-09-16T07:32:22.241 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-09-16T07:32:22.241 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi137.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2024-09-16T07:32:22.242 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:32:22.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:32:22.284 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:32:22.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:32:22.316 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T07:32:22.316 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-09-16T07:32:22.356 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-09-16T07:32:22.391 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T07:32:22.401 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T07:32:22.413 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T07:32:22.414 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi137.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T07:36:05.241 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-09-16T07:36:05.243 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T07:36:05.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:36:05.323 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-09-16T07:36:05.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-09-16T07:36:05.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-16T07:36:05.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T07:36:05.480 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-16T07:36:05.560 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-16T07:36:05.560 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T07:36:05.573 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T07:36:05.573 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:36:05.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:36:05.576 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T07:36:05.576 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:36:05.604 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T07:36:05.618 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T07:36:05.628 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T07:36:05.642 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T07:36:05.643 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-09-16T07:36:05.654 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-09-16T07:36:05.667 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-09-16T07:36:05.668 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T07:36:05.678 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-09-16T07:36:05.682 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T07:36:05.692 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T07:36:05.706 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T07:36:05.739 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:36:05.742 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:36:05.742 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-09-16T07:36:05.742 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:36:05.742 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:36:05.742 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:36:05.742 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:36:05.765 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:36:05.769 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:36:05.769 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-16T07:36:05.770 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:36:05.770 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:36:05.770 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:36:05.770 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:36:05.770 INFO:teuthology.run_tasks:Running task install... 2024-09-16T07:36:05.778 DEBUG:teuthology.task.install:project ceph 2024-09-16T07:36:05.778 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-16T07:36:05.778 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-16T07:36:05.779 INFO:teuthology.task.install:Using flavor: crimson 2024-09-16T07:36:05.785 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T07:36:05.785 INFO:teuthology.task.install:extra packages: [] 2024-09-16T07:36:05.786 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T07:36:05.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:36:05.789 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-16T07:36:05.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:36:05.931 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T07:36:05.931 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T07:36:05.940 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-16T07:36:05.940 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-16T07:36:06.123 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T07:36:06.123 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:36:06.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T07:36:06.124 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T07:36:06.124 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:36:06.124 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T07:36:06.149 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T07:36:06.150 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T07:36:06.151 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T07:36:06.151 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T07:36:06.216 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T07:36:06.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T07:36:06.291 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T07:36:06.292 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T07:36:06.355 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-09-16T07:36:06.356 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-09-16T07:36:06.357 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-09-16T07:36:06.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-09-16T07:36:06.593 INFO:teuthology.orchestra.run.smithi170.stdout:45 files removed 2024-09-16T07:36:06.603 INFO:teuthology.orchestra.run.smithi137.stdout:45 files removed 2024-09-16T07:36:06.620 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw 2024-09-16T07:36:06.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw 2024-09-16T07:36:07.169 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 335 kB/s | 88 kB 00:00 2024-09-16T07:36:07.173 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 344 kB/s | 88 kB 00:00 2024-09-16T07:36:07.461 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-16T07:36:07.473 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-16T07:36:07.736 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-16T07:36:07.749 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-16T07:36:08.617 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.2 MB 00:00 2024-09-16T07:36:09.420 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-16T07:36:12.604 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 20 MB 00:02 2024-09-16T07:36:18.139 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-16T07:36:19.673 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-16T07:36:20.676 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-16T07:36:21.633 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 20 MB 00:11 2024-09-16T07:36:26.132 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-16T07:36:27.184 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-16T07:36:28.458 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:36:28.464 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T07:36:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T07:36:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T07:36:28.467 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout:Install 31 Packages 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2024-09-16T07:36:28.468 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:28.469 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 60 M 2024-09-16T07:36:28.469 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:36:29.168 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-16T07:36:29.319 INFO:teuthology.orchestra.run.smithi170.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 11 MB/s | 6.1 MB 00:00 2024-09-16T07:36:29.358 INFO:teuthology.orchestra.run.smithi170.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 603 kB/s | 25 kB 00:00 2024-09-16T07:36:29.452 INFO:teuthology.orchestra.run.smithi170.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 8.4 MB/s | 809 kB 00:00 2024-09-16T07:36:29.544 INFO:teuthology.orchestra.run.smithi170.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 5.9 MB/s | 558 kB 00:00 2024-09-16T07:36:29.678 INFO:teuthology.orchestra.run.smithi170.stdout:(5/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 11 MB/s | 10 MB 00:00 2024-09-16T07:36:29.878 INFO:teuthology.orchestra.run.smithi170.stdout:(6/33): ceph-common-19.3.0-4879.g81fedcb3.el9.x 18 MB/s | 20 MB 00:01 2024-09-16T07:36:29.903 INFO:teuthology.orchestra.run.smithi170.stdout:(7/33): python3-ceph-argparse-19.3.0-4879.g81fe 200 kB/s | 45 kB 00:00 2024-09-16T07:36:29.928 INFO:teuthology.orchestra.run.smithi170.stdout:(8/33): python3-ceph-common-19.3.0-4879.g81fedc 2.8 MB/s | 143 kB 00:00 2024-09-16T07:36:29.954 INFO:teuthology.orchestra.run.smithi170.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 3.1 MB/s | 160 kB 00:00 2024-09-16T07:36:29.979 INFO:teuthology.orchestra.run.smithi170.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 6.1 MB/s | 315 kB 00:00 2024-09-16T07:36:30.013 INFO:teuthology.orchestra.run.smithi170.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 5.0 MB/s | 302 kB 00:00 2024-09-16T07:36:30.063 INFO:teuthology.orchestra.run.smithi170.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.2 MB/s | 99 kB 00:00 2024-09-16T07:36:30.088 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-16T07:36:30.155 INFO:teuthology.orchestra.run.smithi170.stdout:(13/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_ 8.8 MB/s | 5.4 MB 00:00 2024-09-16T07:36:30.255 INFO:teuthology.orchestra.run.smithi170.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 442 kB/s | 107 kB 00:00 2024-09-16T07:36:30.280 INFO:teuthology.orchestra.run.smithi170.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 786 kB/s | 171 kB 00:00 2024-09-16T07:36:30.314 INFO:teuthology.orchestra.run.smithi170.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-16T07:36:30.340 INFO:teuthology.orchestra.run.smithi170.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 539 kB/s | 45 kB 00:00 2024-09-16T07:36:30.398 INFO:teuthology.orchestra.run.smithi170.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-16T07:36:30.423 INFO:teuthology.orchestra.run.smithi170.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 507 kB/s | 42 kB 00:00 2024-09-16T07:36:30.457 INFO:teuthology.orchestra.run.smithi170.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-16T07:36:30.482 INFO:teuthology.orchestra.run.smithi170.stdout:(21/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-16T07:36:30.507 INFO:teuthology.orchestra.run.smithi170.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 427 kB/s | 36 kB 00:00 2024-09-16T07:36:30.533 INFO:teuthology.orchestra.run.smithi170.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-16T07:36:30.591 INFO:teuthology.orchestra.run.smithi170.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-16T07:36:30.616 INFO:teuthology.orchestra.run.smithi170.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-16T07:36:30.642 INFO:teuthology.orchestra.run.smithi170.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 278 kB/s | 26 kB 00:00 2024-09-16T07:36:30.667 INFO:teuthology.orchestra.run.smithi170.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T07:36:30.701 INFO:teuthology.orchestra.run.smithi170.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-16T07:36:30.751 INFO:teuthology.orchestra.run.smithi170.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-16T07:36:30.810 INFO:teuthology.orchestra.run.smithi170.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-16T07:36:30.885 INFO:teuthology.orchestra.run.smithi170.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-16T07:36:30.985 INFO:teuthology.orchestra.run.smithi170.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-16T07:36:31.077 INFO:teuthology.orchestra.run.smithi170.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-16T07:36:31.082 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:36:31.082 INFO:teuthology.orchestra.run.smithi170.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-16T07:36:31.197 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:36:31.233 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:36:31.233 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:36:31.913 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:36:31.913 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:36:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:36:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T07:36:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:36:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:36:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:36:34.189 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:36:34.261 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:36:34.323 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T07:36:34.352 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T07:36:34.377 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T07:36:34.400 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:36:34.421 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:36:34.626 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:36:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:36:34.693 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T07:36:34.737 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T07:36:34.766 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:36:34.844 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T07:36:34.882 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:36:34.967 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:36:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T07:36:35.133 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T07:36:35.163 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T07:36:35.213 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T07:36:35.245 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T07:36:35.274 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T07:36:35.312 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T07:36:35.561 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-16T07:36:35.689 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T07:36:35.745 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:36:35.836 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:36:35.858 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T07:36:35.894 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T07:36:36.481 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T07:36:36.604 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:36:36.604 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:36:36.663 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T07:36:36.691 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T07:36:37.974 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:36:37.989 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:36:37.989 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:36:37.989 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:36:37.989 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:36:37.989 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-16T07:36:37.989 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-09-16T07:36:37.989 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T07:36:37.990 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-16T07:36:37.991 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout:Install 31 Packages 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 2 Packages 2024-09-16T07:36:37.992 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:36:37.993 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 60 M 2024-09-16T07:36:37.993 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:36:38.856 INFO:teuthology.orchestra.run.smithi137.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 13 MB/s | 6.1 MB 00:00 2024-09-16T07:36:38.923 INFO:teuthology.orchestra.run.smithi137.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 378 kB/s | 25 kB 00:00 2024-09-16T07:36:39.015 INFO:teuthology.orchestra.run.smithi137.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 8.6 MB/s | 809 kB 00:00 2024-09-16T07:36:39.098 INFO:teuthology.orchestra.run.smithi137.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 6.6 MB/s | 558 kB 00:00 2024-09-16T07:36:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:39.424 INFO:teuthology.orchestra.run.smithi137.stdout:(5/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 10 MB/s | 10 MB 00:01 2024-09-16T07:36:39.507 INFO:teuthology.orchestra.run.smithi137.stdout:(6/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 13 MB/s | 5.4 MB 00:00 2024-09-16T07:36:39.532 INFO:teuthology.orchestra.run.smithi137.stdout:(7/33): python3-ceph-argparse-19.3.0-4879.g81fe 416 kB/s | 45 kB 00:00 2024-09-16T07:36:39.558 INFO:teuthology.orchestra.run.smithi137.stdout:(8/33): python3-ceph-common-19.3.0-4879.g81fedc 2.8 MB/s | 143 kB 00:00 2024-09-16T07:36:39.583 INFO:teuthology.orchestra.run.smithi137.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 3.1 MB/s | 160 kB 00:00 2024-09-16T07:36:39.608 INFO:teuthology.orchestra.run.smithi137.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 6.1 MB/s | 315 kB 00:00 2024-09-16T07:36:39.633 INFO:teuthology.orchestra.run.smithi137.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 5.9 MB/s | 302 kB 00:00 2024-09-16T07:36:39.817 INFO:teuthology.orchestra.run.smithi137.stdout:(12/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 14 MB/s | 20 MB 00:01 2024-09-16T07:36:39.835 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:39.842 INFO:teuthology.orchestra.run.smithi137.stdout:(13/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 425 kB/s | 99 kB 00:00 2024-09-16T07:36:39.874 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:36:39.970 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:36:39.970 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T07:36:39.970 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T07:36:39.970 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:40.000 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:36:40.501 INFO:teuthology.orchestra.run.smithi137.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 123 kB/s | 107 kB 00:00 2024-09-16T07:36:40.568 INFO:teuthology.orchestra.run.smithi137.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 221 kB/s | 160 kB 00:00 2024-09-16T07:36:40.610 INFO:teuthology.orchestra.run.smithi137.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 215 kB/s | 171 kB 00:00 2024-09-16T07:36:41.068 INFO:teuthology.orchestra.run.smithi137.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 80 kB/s | 45 kB 00:00 2024-09-16T07:36:41.402 INFO:teuthology.orchestra.run.smithi137.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-16T07:36:41.444 INFO:teuthology.orchestra.run.smithi137.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 757 kB/s | 662 kB 00:00 2024-09-16T07:36:41.703 INFO:teuthology.orchestra.run.smithi137.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 67 kB/s | 42 kB 00:00 2024-09-16T07:36:42.003 INFO:teuthology.orchestra.run.smithi137.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 64 kB/s | 36 kB 00:00 2024-09-16T07:36:42.053 INFO:teuthology.orchestra.run.smithi137.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.2 MB/s | 308 kB 00:00 2024-09-16T07:36:42.162 INFO:teuthology.orchestra.run.smithi137.stdout:(23/33): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-16T07:36:42.255 INFO:teuthology.orchestra.run.smithi137.stdout:(24/33): qatlib-24.02.0-1.el9.x86_64.rpm 259 kB/s | 221 kB 00:00 2024-09-16T07:36:42.279 INFO:teuthology.orchestra.run.smithi137.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-09-16T07:36:42.312 INFO:teuthology.orchestra.run.smithi137.stdout:(26/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 78 kB/s | 47 kB 00:00 2024-09-16T07:36:42.338 INFO:teuthology.orchestra.run.smithi137.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T07:36:42.372 INFO:teuthology.orchestra.run.smithi137.stdout:(28/33): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-09-16T07:36:42.405 INFO:teuthology.orchestra.run.smithi137.stdout:(29/33): re2-20211101-20.el9.x86_64.rpm 3.1 MB/s | 191 kB 00:00 2024-09-16T07:36:42.447 INFO:teuthology.orchestra.run.smithi137.stdout:(30/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.2 MB/s | 839 kB 00:00 2024-09-16T07:36:42.489 INFO:teuthology.orchestra.run.smithi137.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-16T07:36:42.665 INFO:teuthology.orchestra.run.smithi137.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-16T07:36:42.740 INFO:teuthology.orchestra.run.smithi137.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 13 MB/s | 3.8 MB 00:00 2024-09-16T07:36:42.746 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:36:42.747 INFO:teuthology.orchestra.run.smithi137.stdout:Total 13 MB/s | 60 MB 00:04 2024-09-16T07:36:42.864 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:36:42.902 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:36:42.902 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:36:43.554 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:36:43.554 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:36:45.059 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:36:45.581 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T07:36:45.642 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:36:45.734 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:36:45.829 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:36:45.860 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:36:45.923 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:36:45.969 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-16T07:36:45.998 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-16T07:36:46.031 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-16T07:36:46.062 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:36:46.087 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-16T07:36:46.540 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:36:46.571 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-16T07:36:46.615 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-16T07:36:46.658 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-16T07:36:46.687 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:36:46.777 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-16T07:36:46.800 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:36:46.889 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-16T07:36:46.925 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-16T07:36:47.033 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-16T07:36:47.076 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-16T07:36:47.125 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-16T07:36:47.166 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-16T07:36:47.195 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-16T07:36:47.239 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-16T07:36:47.600 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T07:36:47.649 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:36:47.740 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-16T07:36:47.771 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-16T07:36:47.807 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T07:36:48.389 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T07:36:48.418 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:36:48.490 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-16T07:36:48.568 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-16T07:36:48.604 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-16T07:36:50.345 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:36:50.345 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-09-16T07:36:50.345 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-09-16T07:36:50.345 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-09-16T07:36:50.345 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-09-16T07:36:50.345 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-09-16T07:36:50.346 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-09-16T07:36:50.346 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-09-16T07:36:50.346 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:51.017 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:51.059 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:51.471 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:36:51.496 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:36:51.496 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:36:51.496 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T07:36:51.497 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:36:51.497 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:36:51.497 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:51.498 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:36:51.581 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:36:51.581 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:36:51.797 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-16T07:36:51.838 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:36:51.919 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-16T07:36:51.919 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T07:36:51.919 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T07:36:51.919 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:36:51.956 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:36:52.966 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:36:52.966 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T07:36:52.966 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:36:52.966 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T07:36:52.967 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T07:36:52.968 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T07:36:52.969 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T07:36:52.969 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T07:36:52.970 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T07:36:52.970 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T07:36:52.970 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T07:36:52.970 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:36:52.970 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T07:36:52.970 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T07:36:53.914 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:36:53.914 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:53.914 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-09-16T07:36:53.914 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.915 INFO:teuthology.orchestra.run.smithi170.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:53.917 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:36:54.244 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-test 2024-09-16T07:36:54.812 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:28 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:36:54.952 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:36:54.953 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:36:54.953 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:36:54.953 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:36:54.953 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:36:54.953 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T07:36:54.953 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:36:54.953 INFO:teuthology.orchestra.run.smithi170.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout:Install 9 Packages 2024-09-16T07:36:54.954 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:36:54.955 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 87 M 2024-09-16T07:36:54.955 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 797 M 2024-09-16T07:36:54.955 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:36:55.495 INFO:teuthology.orchestra.run.smithi170.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 786 kB/s | 94 kB 00:00 2024-09-16T07:36:55.595 INFO:teuthology.orchestra.run.smithi170.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 795 kB/s | 175 kB 00:00 2024-09-16T07:36:55.621 INFO:teuthology.orchestra.run.smithi170.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 4.0 MB/s | 513 kB 00:00 2024-09-16T07:36:55.687 INFO:teuthology.orchestra.run.smithi170.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-16T07:36:55.729 INFO:teuthology.orchestra.run.smithi170.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-16T07:36:55.754 INFO:teuthology.orchestra.run.smithi170.stdout:(6/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 183 kB 00:00 2024-09-16T07:36:55.771 INFO:teuthology.orchestra.run.smithi170.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-16T07:36:55.822 INFO:teuthology.orchestra.run.smithi170.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-16T07:36:57.863 INFO:teuthology.orchestra.run.smithi170.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 34 MB/s | 85 MB 00:02 2024-09-16T07:36:57.866 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:36:57.866 INFO:teuthology.orchestra.run.smithi170.stdout:Total 30 MB/s | 87 MB 00:02 2024-09-16T07:36:57.951 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:36:57.973 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:36:57.974 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:36:58.587 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:36:58.587 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:36:59.489 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:36:59.554 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T07:36:59.602 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T07:36:59.651 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T07:36:59.677 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T07:36:59.708 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:36:59.751 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:36:59.822 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:36:59.867 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T07:36:59.894 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:37:02.396 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:37:02.396 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-09-16T07:37:02.396 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-09-16T07:37:02.396 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-09-16T07:37:02.396 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-09-16T07:37:02.396 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-09-16T07:37:02.396 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-09-16T07:37:02.396 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-09-16T07:37:02.397 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:03.506 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:37:03.531 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-16T07:37:03.531 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T07:37:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:37:03.532 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T07:37:03.532 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:03.533 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:37:03.625 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T07:37:03.625 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:37:04.920 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:37:04.920 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-16T07:37:04.920 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-16T07:37:04.920 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-16T07:37:04.920 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-16T07:37:04.920 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-16T07:37:04.920 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-16T07:37:04.920 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T07:37:04.921 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T07:37:04.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T07:37:04.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T07:37:04.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T07:37:04.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T07:37:04.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T07:37:04.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T07:37:04.922 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T07:37:04.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T07:37:04.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T07:37:04.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T07:37:04.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T07:37:04.923 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T07:37:04.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T07:37:04.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-16T07:37:04.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T07:37:04.924 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-16T07:37:05.781 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T07:37:05.781 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-09-16T07:37:05.782 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.782 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.782 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:37:05.782 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T07:37:05.782 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.783 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.783 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.783 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.783 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T07:37:05.783 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T07:37:05.784 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T07:37:05.784 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.784 INFO:teuthology.orchestra.run.smithi137.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T07:37:05.784 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T07:37:05.784 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T07:37:05.785 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T07:37:05.785 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.785 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T07:37:05.785 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.785 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T07:37:05.785 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T07:37:05.786 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T07:37:05.786 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.786 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.786 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.786 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T07:37:05.787 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.787 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.787 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:05.787 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T07:37:05.787 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T07:37:05.787 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T07:37:05.788 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T07:37:05.788 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T07:37:05.788 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:05.788 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:37:06.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-test 2024-09-16T07:37:06.702 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:31 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:37:06.844 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:37:06.845 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:06.845 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:37:06.845 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:06.845 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:37:06.845 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-16T07:37:06.845 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:37:06.845 INFO:teuthology.orchestra.run.smithi137.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout:Install 9 Packages 2024-09-16T07:37:06.846 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:06.847 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 87 M 2024-09-16T07:37:06.847 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 797 M 2024-09-16T07:37:06.847 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:37:07.265 INFO:teuthology.orchestra.run.smithi137.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 709 kB/s | 94 kB 00:00 2024-09-16T07:37:07.374 INFO:teuthology.orchestra.run.smithi137.stdout:(2/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 725 kB/s | 175 kB 00:00 2024-09-16T07:37:07.923 INFO:teuthology.orchestra.run.smithi137.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 332 kB/s | 183 kB 00:00 2024-09-16T07:37:08.098 INFO:teuthology.orchestra.run.smithi137.stdout:(4/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 616 kB/s | 513 kB 00:00 2024-09-16T07:37:08.307 INFO:teuthology.orchestra.run.smithi137.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-16T07:37:08.390 INFO:teuthology.orchestra.run.smithi137.stdout:(6/9): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-09-16T07:37:08.424 INFO:teuthology.orchestra.run.smithi137.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 546 kB/s | 64 kB 00:00 2024-09-16T07:37:08.449 INFO:teuthology.orchestra.run.smithi137.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-16T07:37:09.717 INFO:teuthology.orchestra.run.smithi137.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 33 MB/s | 85 MB 00:02 2024-09-16T07:37:09.719 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:09.720 INFO:teuthology.orchestra.run.smithi137.stdout:Total 30 MB/s | 87 MB 00:02 2024-09-16T07:37:09.805 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:37:09.827 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:37:09.827 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:37:10.450 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:37:10.450 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:37:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:37:11.266 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:37:11.336 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:37:11.418 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-16T07:37:11.466 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-16T07:37:11.520 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-16T07:37:11.556 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-16T07:37:11.587 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:37:11.611 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:37:11.684 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-16T07:37:11.729 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-16T07:37:11.755 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:37:17.489 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:37:17.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T07:37:17.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T07:37:17.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T07:37:17.490 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T07:37:17.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:37:17.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T07:37:17.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T07:37:17.491 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T07:37:17.900 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T07:37:17.900 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:17.900 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:37:17.901 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:17.901 INFO:teuthology.orchestra.run.smithi170.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T07:37:17.901 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:17.901 INFO:teuthology.orchestra.run.smithi170.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T07:37:17.901 INFO:teuthology.orchestra.run.smithi170.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T07:37:17.901 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T07:37:17.901 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T07:37:17.902 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T07:37:17.902 INFO:teuthology.orchestra.run.smithi170.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T07:37:17.902 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:17.902 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:37:18.237 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph 2024-09-16T07:37:18.805 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:52 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:37:18.944 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:18.946 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T07:37:18.947 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T07:37:18.948 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T07:37:18.949 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout:Install 37 Packages 2024-09-16T07:37:18.950 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:18.951 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 84 M 2024-09-16T07:37:18.951 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 897 M 2024-09-16T07:37:18.951 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:37:19.319 INFO:teuthology.orchestra.run.smithi170.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-16T07:37:19.502 INFO:teuthology.orchestra.run.smithi170.stdout:(2/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 7.3 MB/s | 2.2 MB 00:00 2024-09-16T07:37:19.553 INFO:teuthology.orchestra.run.smithi170.stdout:(3/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 4.5 MB/s | 1.6 MB 00:00 2024-09-16T07:37:19.653 INFO:teuthology.orchestra.run.smithi170.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 2.8 MB/s | 291 kB 00:00 2024-09-16T07:37:19.745 INFO:teuthology.orchestra.run.smithi170.stdout:(5/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 12 MB/s | 5.1 MB 00:00 2024-09-16T07:37:19.953 INFO:teuthology.orchestra.run.smithi170.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 843 kB/s | 253 kB 00:00 2024-09-16T07:37:20.020 INFO:teuthology.orchestra.run.smithi170.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-16T07:37:20.095 INFO:teuthology.orchestra.run.smithi170.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 3.5 MB/s | 1.2 MB 00:00 2024-09-16T07:37:20.120 INFO:teuthology.orchestra.run.smithi170.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.3 MB/s | 135 kB 00:00 2024-09-16T07:37:20.149 INFO:teuthology.orchestra.run.smithi170.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.3 MB/s | 125 kB 00:00 2024-09-16T07:37:20.200 INFO:teuthology.orchestra.run.smithi170.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.7 MB/s | 215 kB 00:00 2024-09-16T07:37:20.358 INFO:teuthology.orchestra.run.smithi170.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 904 kB/s | 188 kB 00:00 2024-09-16T07:37:20.392 INFO:teuthology.orchestra.run.smithi170.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 897 kB/s | 172 kB 00:00 2024-09-16T07:37:20.417 INFO:teuthology.orchestra.run.smithi170.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 594 kB/s | 35 kB 00:00 2024-09-16T07:37:20.443 INFO:teuthology.orchestra.run.smithi170.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-16T07:37:20.468 INFO:teuthology.orchestra.run.smithi170.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-16T07:37:20.485 INFO:teuthology.orchestra.run.smithi170.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 998 kB/s | 42 kB 00:00 2024-09-16T07:37:20.527 INFO:teuthology.orchestra.run.smithi170.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-16T07:37:20.552 INFO:teuthology.orchestra.run.smithi170.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 265 kB/s | 22 kB 00:00 2024-09-16T07:37:20.577 INFO:teuthology.orchestra.run.smithi170.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 864 kB/s | 43 kB 00:00 2024-09-16T07:37:20.611 INFO:teuthology.orchestra.run.smithi170.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2024-09-16T07:37:20.636 INFO:teuthology.orchestra.run.smithi170.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 459 kB/s | 11 kB 00:00 2024-09-16T07:37:20.662 INFO:teuthology.orchestra.run.smithi170.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 708 kB/s | 18 kB 00:00 2024-09-16T07:37:20.695 INFO:teuthology.orchestra.run.smithi170.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-16T07:37:20.720 INFO:teuthology.orchestra.run.smithi170.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 397 kB/s | 23 kB 00:00 2024-09-16T07:37:20.746 INFO:teuthology.orchestra.run.smithi170.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 776 kB/s | 19 kB 00:00 2024-09-16T07:37:20.773 INFO:teuthology.orchestra.run.smithi170.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-16T07:37:20.797 INFO:teuthology.orchestra.run.smithi170.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-16T07:37:20.821 INFO:teuthology.orchestra.run.smithi170.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T07:37:20.847 INFO:teuthology.orchestra.run.smithi170.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 658 kB/s | 16 kB 00:00 2024-09-16T07:37:20.872 INFO:teuthology.orchestra.run.smithi170.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-16T07:37:20.897 INFO:teuthology.orchestra.run.smithi170.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-16T07:37:20.923 INFO:teuthology.orchestra.run.smithi170.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 709 kB/s | 36 kB 00:00 2024-09-16T07:37:20.948 INFO:teuthology.orchestra.run.smithi170.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T07:37:20.973 INFO:teuthology.orchestra.run.smithi170.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-16T07:37:20.998 INFO:teuthology.orchestra.run.smithi170.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-16T07:37:21.874 INFO:teuthology.orchestra.run.smithi170.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 30 MB/s | 70 MB 00:02 2024-09-16T07:37:21.878 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:21.878 INFO:teuthology.orchestra.run.smithi170.stdout:Total 29 MB/s | 84 MB 00:02 2024-09-16T07:37:22.031 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:37:22.072 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:37:22.072 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:37:22.872 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:37:22.873 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:37:23.008 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-16T07:37:23.085 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:37:24.525 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:37:24.585 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T07:37:24.618 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T07:37:24.645 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T07:37:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T07:37:24.769 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T07:37:24.802 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T07:37:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T07:37:24.972 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T07:37:25.021 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T07:37:25.056 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T07:37:25.086 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T07:37:25.121 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T07:37:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T07:37:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T07:37:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T07:37:25.273 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T07:37:25.321 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T07:37:25.356 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T07:37:25.428 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T07:37:25.576 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T07:37:25.655 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T07:37:25.709 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T07:37:25.747 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T07:37:25.796 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T07:37:25.851 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T07:37:26.045 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T07:37:26.093 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T07:37:26.162 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T07:37:26.251 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T07:37:26.299 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T07:37:26.431 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T07:37:26.629 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T07:37:26.661 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:37:26.687 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:37:26.687 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:26.687 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T07:37:26.687 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:37:26.687 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:37:26.687 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-16T07:37:29.062 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-16T07:37:29.506 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:29.507 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:37:29.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph 2024-09-16T07:37:30.421 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:55 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:37:30.557 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-16T07:37:30.560 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T07:37:30.561 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T07:37:30.562 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout:Install 37 Packages 2024-09-16T07:37:30.563 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:30.564 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 84 M 2024-09-16T07:37:30.564 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 897 M 2024-09-16T07:37:30.564 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:37:31.175 INFO:teuthology.orchestra.run.smithi137.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-16T07:37:31.341 INFO:teuthology.orchestra.run.smithi137.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 5.2 MB/s | 1.6 MB 00:00 2024-09-16T07:37:31.566 INFO:teuthology.orchestra.run.smithi137.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 4.1 MB/s | 2.2 MB 00:00 2024-09-16T07:37:31.616 INFO:teuthology.orchestra.run.smithi137.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 5.7 MB/s | 291 kB 00:00 2024-09-16T07:37:31.842 INFO:teuthology.orchestra.run.smithi137.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-16T07:37:31.992 INFO:teuthology.orchestra.run.smithi137.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 8.2 MB/s | 1.2 MB 00:00 2024-09-16T07:37:32.042 INFO:teuthology.orchestra.run.smithi137.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-16T07:37:32.092 INFO:teuthology.orchestra.run.smithi137.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.7 MB/s | 135 kB 00:00 2024-09-16T07:37:32.151 INFO:teuthology.orchestra.run.smithi137.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-16T07:37:32.218 INFO:teuthology.orchestra.run.smithi137.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.2 MB/s | 215 kB 00:00 2024-09-16T07:37:32.294 INFO:teuthology.orchestra.run.smithi137.stdout:(11/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 4.6 MB/s | 5.1 MB 00:01 2024-09-16T07:37:32.377 INFO:teuthology.orchestra.run.smithi137.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-16T07:37:32.402 INFO:teuthology.orchestra.run.smithi137.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-09-16T07:37:32.453 INFO:teuthology.orchestra.run.smithi137.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 462 kB/s | 35 kB 00:00 2024-09-16T07:37:32.478 INFO:teuthology.orchestra.run.smithi137.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-16T07:37:32.537 INFO:teuthology.orchestra.run.smithi137.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-16T07:37:32.562 INFO:teuthology.orchestra.run.smithi137.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-09-16T07:37:32.604 INFO:teuthology.orchestra.run.smithi137.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-16T07:37:32.629 INFO:teuthology.orchestra.run.smithi137.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-16T07:37:32.655 INFO:teuthology.orchestra.run.smithi137.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-16T07:37:32.680 INFO:teuthology.orchestra.run.smithi137.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-16T07:37:32.714 INFO:teuthology.orchestra.run.smithi137.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 401 kB/s | 11 kB 00:00 2024-09-16T07:37:32.739 INFO:teuthology.orchestra.run.smithi137.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 763 kB/s | 18 kB 00:00 2024-09-16T07:37:32.764 INFO:teuthology.orchestra.run.smithi137.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 925 kB/s | 23 kB 00:00 2024-09-16T07:37:32.789 INFO:teuthology.orchestra.run.smithi137.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 774 kB/s | 19 kB 00:00 2024-09-16T07:37:32.823 INFO:teuthology.orchestra.run.smithi137.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 590 kB/s | 20 kB 00:00 2024-09-16T07:37:32.848 INFO:teuthology.orchestra.run.smithi137.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.8 MB/s | 358 kB 00:00 2024-09-16T07:37:32.891 INFO:teuthology.orchestra.run.smithi137.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 686 kB/s | 46 kB 00:00 2024-09-16T07:37:32.916 INFO:teuthology.orchestra.run.smithi137.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-16T07:37:32.942 INFO:teuthology.orchestra.run.smithi137.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 655 kB/s | 16 kB 00:00 2024-09-16T07:37:32.967 INFO:teuthology.orchestra.run.smithi137.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-16T07:37:32.992 INFO:teuthology.orchestra.run.smithi137.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-16T07:37:33.018 INFO:teuthology.orchestra.run.smithi137.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-16T07:37:33.059 INFO:teuthology.orchestra.run.smithi137.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-09-16T07:37:33.085 INFO:teuthology.orchestra.run.smithi137.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 797 kB/s | 20 kB 00:00 2024-09-16T07:37:33.118 INFO:teuthology.orchestra.run.smithi137.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-16T07:37:33.777 INFO:teuthology.orchestra.run.smithi137.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 29 MB/s | 70 MB 00:02 2024-09-16T07:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:33.782 INFO:teuthology.orchestra.run.smithi137.stdout:Total 26 MB/s | 84 MB 00:03 2024-09-16T07:37:33.936 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:37:33.978 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:37:33.978 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:37:34.772 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:37:34.772 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:37:36.451 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:37:36.538 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T07:37:36.579 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T07:37:36.623 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T07:37:36.713 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T07:37:36.756 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T07:37:36.789 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T07:37:36.881 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T07:37:36.975 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T07:37:37.016 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T07:37:37.051 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T07:37:37.081 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T07:37:37.116 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T07:37:37.149 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T07:37:37.190 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T07:37:37.224 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T07:37:37.253 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:37:37.259 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T07:37:37.280 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:37:37.280 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:37.280 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T07:37:37.280 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:37:37.281 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:37:37.281 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:37.308 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T07:37:37.339 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T07:37:37.413 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T07:37:37.560 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T07:37:37.639 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T07:37:37.692 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T07:37:37.731 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T07:37:37.780 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T07:37:37.829 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:37:37.835 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T07:37:37.856 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:37:37.856 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:37.856 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T07:37:37.856 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:37:37.856 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:37:37.856 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:38.039 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T07:37:38.085 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T07:37:38.097 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:37:38.122 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:37:38.142 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:38.142 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T07:37:38.142 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:37:38.142 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:37:38.142 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:38.163 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T07:37:38.186 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:37:38.252 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T07:37:38.289 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T07:37:38.429 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T07:37:38.630 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-16T07:37:38.661 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:37:38.688 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-16T07:37:38.688 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:38.688 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T07:37:38.688 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:37:38.689 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T07:37:38.689 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:44.806 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T07:37:44.807 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T07:37:44.808 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T07:37:44.808 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T07:37:44.808 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T07:37:44.808 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T07:37:44.808 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T07:37:44.808 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T07:37:44.809 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T07:37:44.809 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T07:37:44.809 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T07:37:44.809 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T07:37:44.809 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T07:37:44.809 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T07:37:44.809 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T07:37:44.810 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T07:37:44.811 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T07:37:44.811 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T07:37:44.811 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T07:37:44.811 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T07:37:44.811 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T07:37:44.811 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T07:37:44.811 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T07:37:44.811 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T07:37:44.812 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T07:37:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T07:37:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T07:37:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T07:37:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T07:37:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T07:37:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:45.956 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:37:46.218 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-base 2024-09-16T07:37:46.784 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:20 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:37:46.874 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:37:46.917 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:37:46.918 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:37:46.918 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:37:46.997 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install cephadm 2024-09-16T07:37:47.559 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:21 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:37:47.690 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 785 k 2024-09-16T07:37:47.691 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 791 k 2024-09-16T07:37:47.692 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:37:47.962 INFO:teuthology.orchestra.run.smithi170.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 2.8 MB/s | 785 kB 00:00 2024-09-16T07:37:47.963 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:47.963 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.8 MB/s | 785 kB 00:00 2024-09-16T07:37:47.963 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:37:47.968 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:37:47.968 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:37:47.974 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:37:47.975 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:37:48.046 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:37:48.498 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:37:48.590 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:37:48.956 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:37:49.208 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:37:49.208 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:49.208 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:37:49.208 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:49.208 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:49.208 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:37:49.211 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:37:49.239 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-16T07:37:49.239 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:49.239 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T07:37:49.239 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:37:49.239 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T07:37:49.239 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:49.443 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T07:37:49.787 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:37:49.810 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-16T07:37:49.810 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:49.810 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T07:37:49.810 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:37:49.810 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T07:37:49.811 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:50.023 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:24 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:37:50.046 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:37:50.069 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-16T07:37:50.069 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:50.070 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T07:37:50.070 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:37:50.070 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T07:37:50.070 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:50.134 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:37:50.161 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:50.162 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-16T07:37:50.163 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:50.163 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 158 k 2024-09-16T07:37:50.163 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 644 k 2024-09-16T07:37:50.163 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:37:50.362 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 792 kB/s | 158 kB 00:00 2024-09-16T07:37:50.363 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:50.363 INFO:teuthology.orchestra.run.smithi170.stdout:Total 787 kB/s | 158 kB 00:00 2024-09-16T07:37:50.363 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:37:50.372 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:37:50.372 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:37:50.429 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:37:50.430 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:37:50.573 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:37:50.646 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:37:50.672 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:37:50.672 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:37:50.672 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T07:37:50.672 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:51.562 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:37:51.562 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:51.562 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:37:51.562 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:51.562 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:51.563 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:37:51.782 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr 2024-09-16T07:37:52.360 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:26 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:37:52.456 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:37:52.498 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:37:52.499 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:37:52.499 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:37:52.591 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T07:37:53.156 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:27 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:37:53.290 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:37:53.291 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:53.291 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:37:53.291 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:53.291 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:37:53.291 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T07:37:53.291 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:37:53.291 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T07:37:53.291 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout:Install 11 Packages 2024-09-16T07:37:53.292 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:37:53.293 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 18 M 2024-09-16T07:37:53.293 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 155 M 2024-09-16T07:37:53.293 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:37:54.066 INFO:teuthology.orchestra.run.smithi170.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 124 kB/s | 34 kB 00:00 2024-09-16T07:37:54.091 INFO:teuthology.orchestra.run.smithi170.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 55 kB/s | 16 kB 00:00 2024-09-16T07:37:54.225 INFO:teuthology.orchestra.run.smithi170.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-09-16T07:37:54.284 INFO:teuthology.orchestra.run.smithi170.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T07:37:54.309 INFO:teuthology.orchestra.run.smithi170.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-16T07:37:54.384 INFO:teuthology.orchestra.run.smithi170.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-16T07:37:54.418 INFO:teuthology.orchestra.run.smithi170.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-16T07:37:54.459 INFO:teuthology.orchestra.run.smithi170.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 751 kB/s | 31 kB 00:00 2024-09-16T07:37:54.493 INFO:teuthology.orchestra.run.smithi170.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.4 MB/s | 188 kB 00:00 2024-09-16T07:37:55.094 INFO:teuthology.orchestra.run.smithi170.stdout:(10/11): protobuf-compiler-3.14.0-13.el9.x86_64 862 kB/s | 863 kB 00:01 2024-09-16T07:37:55.294 INFO:teuthology.orchestra.run.smithi170.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 9.4 MB/s | 14 MB 00:01 2024-09-16T07:37:55.297 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:37:55.298 INFO:teuthology.orchestra.run.smithi170.stdout:Total 9.1 MB/s | 18 MB 00:02 2024-09-16T07:37:55.331 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:37:55.351 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:37:55.351 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:37:55.608 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:37:55.608 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:37:56.165 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:37:56.250 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T07:37:56.280 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T07:37:56.375 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T07:37:56.508 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T07:37:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T07:37:56.643 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T07:37:56.711 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T07:37:56.739 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:37:56.772 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T07:37:56.926 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T07:37:56.927 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T07:37:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T07:37:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T07:37:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T07:37:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T07:37:56.928 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T07:37:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T07:37:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T07:37:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T07:37:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T07:37:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T07:37:56.929 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T07:37:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T07:37:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T07:37:56.930 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T07:37:58.083 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T07:37:58.084 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:58.084 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:37:58.084 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:58.084 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:58.084 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:58.084 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:37:58.084 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:58.084 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T07:37:58.085 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T07:37:58.086 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T07:37:58.087 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T07:37:58.087 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T07:37:58.087 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T07:37:58.087 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T07:37:58.087 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:58.087 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:37:58.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-base 2024-09-16T07:37:58.978 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:23 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:37:59.080 INFO:teuthology.orchestra.run.smithi137.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:37:59.125 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:37:59.126 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:37:59.126 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:37:59.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install cephadm 2024-09-16T07:37:59.788 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:24 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:37:59.924 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:37:59.925 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:37:59.925 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:59.925 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:37:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-16T07:37:59.925 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:59.926 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:37:59.926 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:37:59.926 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-09-16T07:37:59.926 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:37:59.926 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 785 k 2024-09-16T07:37:59.926 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 791 k 2024-09-16T07:37:59.926 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:37:59.975 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T07:38:00.043 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:38:00.513 INFO:teuthology.orchestra.run.smithi137.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 1.3 MB/s | 785 kB 00:00 2024-09-16T07:38:00.513 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:00.514 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.3 MB/s | 785 kB 00:00 2024-09-16T07:38:00.514 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:00.519 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:00.520 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:00.525 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:00.526 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:00.598 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:01.099 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:01.235 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:01.612 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:01.866 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:01.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:01.867 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:01.867 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:01.867 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:01.867 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:02.005 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:38:02.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T07:38:02.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T07:38:02.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T07:38:02.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T07:38:02.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T07:38:02.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T07:38:02.005 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T07:38:02.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:38:02.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T07:38:02.006 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T07:38:02.086 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T07:38:02.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T07:38:02.325 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T07:38:02.326 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T07:38:02.326 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:02.326 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:02.569 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T07:38:02.663 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:27 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:02.798 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:02.799 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:02.799 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-09-16T07:38:02.799 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:02.799 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:02.799 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-16T07:38:02.799 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:02.800 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:02.800 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:02.800 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-09-16T07:38:02.800 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:02.800 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 158 k 2024-09-16T07:38:02.800 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 644 k 2024-09-16T07:38:02.800 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:03.129 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 480 kB/s | 158 kB 00:00 2024-09-16T07:38:03.130 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:03.130 INFO:teuthology.orchestra.run.smithi137.stdout:Total 477 kB/s | 158 kB 00:00 2024-09-16T07:38:03.130 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:03.134 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:37 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:03.140 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:03.140 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:03.197 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:03.198 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:03.268 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:03.269 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-09-16T07:38:03.269 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:38:03.269 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-09-16T07:38:03.269 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T07:38:03.270 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T07:38:03.271 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T07:38:03.271 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:03.271 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:03.271 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-09-16T07:38:03.271 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-09-16T07:38:03.271 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:03.271 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 38 M 2024-09-16T07:38:03.272 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 212 M 2024-09-16T07:38:03.272 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:03.351 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:03.439 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:38:03.464 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:38:03.464 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:38:03.464 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T07:38:03.464 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:03.541 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 939 kB/s | 191 kB 00:00 2024-09-16T07:38:03.650 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-16T07:38:03.850 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 106 kB/s | 33 kB 00:00 2024-09-16T07:38:03.959 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-09-16T07:38:04.076 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-16T07:38:04.375 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-16T07:38:04.375 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:04.375 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:04.375 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:04.375 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:04.375 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:04.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr 2024-09-16T07:38:04.860 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.5 MB/s | 3.0 MB 00:01 2024-09-16T07:38:04.985 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-16T07:38:05.193 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:30 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:05.288 INFO:teuthology.orchestra.run.smithi137.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:05.330 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:05.331 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:38:05.331 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:05.400 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T07:38:05.668 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 3.1 MB/s | 4.9 MB 00:01 2024-09-16T07:38:05.962 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:30 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:06.060 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 640 kB/s | 250 kB 00:00 2024-09-16T07:38:06.095 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:06.096 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:06.096 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:38:06.096 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:06.096 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:06.096 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T07:38:06.097 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi137.stdout:Install 11 Packages 2024-09-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 18 M 2024-09-16T07:38:06.098 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 155 M 2024-09-16T07:38:06.099 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): ceph-mgr-diskprediction-local-19.3.0-4 2.5 MB/s | 7.4 MB 00:02 2024-09-16T07:38:06.616 INFO:teuthology.orchestra.run.smithi137.stdout:(1/11): ceph-prometheus-alerts-19.3.0-4879.g81f 71 kB/s | 16 kB 00:00 2024-09-16T07:38:06.641 INFO:teuthology.orchestra.run.smithi137.stdout:(2/11): ceph-grafana-dashboards-19.3.0-4879.g81 134 kB/s | 34 kB 00:00 2024-09-16T07:38:06.775 INFO:teuthology.orchestra.run.smithi137.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.7 MB/s | 269 kB 00:00 2024-09-16T07:38:06.825 INFO:teuthology.orchestra.run.smithi137.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-16T07:38:06.851 INFO:teuthology.orchestra.run.smithi137.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-16T07:38:06.917 INFO:teuthology.orchestra.run.smithi137.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-16T07:38:06.951 INFO:teuthology.orchestra.run.smithi137.stdout:(7/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.7 MB/s | 863 kB 00:00 2024-09-16T07:38:06.985 INFO:teuthology.orchestra.run.smithi137.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-16T07:38:07.027 INFO:teuthology.orchestra.run.smithi137.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 4.6 MB/s | 188 kB 00:00 2024-09-16T07:38:07.052 INFO:teuthology.orchestra.run.smithi137.stdout:(10/11): python3-repoze-lru-0.7-16.el9.noarch.r 306 kB/s | 31 kB 00:00 2024-09-16T07:38:07.944 INFO:teuthology.orchestra.run.smithi137.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 9.1 MB/s | 14 MB 00:01 2024-09-16T07:38:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:07.949 INFO:teuthology.orchestra.run.smithi137.stdout:Total 9.9 MB/s | 18 MB 00:01 2024-09-16T07:38:07.980 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:08.001 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:08.001 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:08.265 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:08.266 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:08.816 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:08.900 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-16T07:38:08.931 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-16T07:38:09.022 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-16T07:38:09.148 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-16T07:38:09.217 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-16T07:38:09.337 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-16T07:38:09.394 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-16T07:38:09.422 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:38:09.455 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-16T07:38:09.952 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.0 MB/s | 5.1 MB 00:04 2024-09-16T07:38:12.645 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-16T07:38:12.700 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:38:14.630 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-16T07:38:14.631 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-16T07:38:14.941 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T07:38:14.942 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T07:38:14.943 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T07:38:14.943 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:14.943 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:15.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T07:38:15.493 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.7 MB/s | 16 MB 00:09 2024-09-16T07:38:15.494 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:15.494 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.1 MB/s | 38 MB 00:12 2024-09-16T07:38:15.788 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:15.853 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:15.879 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:15.879 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:15.922 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:15.923 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-09-16T07:38:15.923 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:38:15.923 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T07:38:15.924 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T07:38:15.925 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T07:38:15.925 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T07:38:15.925 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T07:38:15.925 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:15.925 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:15.925 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-09-16T07:38:15.925 INFO:teuthology.orchestra.run.smithi137.stdout:Install 12 Packages 2024-09-16T07:38:15.925 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:15.926 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 38 M 2024-09-16T07:38:15.926 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 212 M 2024-09-16T07:38:15.926 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:16.241 INFO:teuthology.orchestra.run.smithi137.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-16T07:38:16.283 INFO:teuthology.orchestra.run.smithi137.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-16T07:38:16.318 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:16.319 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:16.524 INFO:teuthology.orchestra.run.smithi137.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 115 kB/s | 33 kB 00:00 2024-09-16T07:38:16.641 INFO:teuthology.orchestra.run.smithi137.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-16T07:38:16.759 INFO:teuthology.orchestra.run.smithi137.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-16T07:38:17.104 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:17.183 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T07:38:17.224 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:38:17.322 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:38:17.325 INFO:teuthology.orchestra.run.smithi137.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.9 MB/s | 3.0 MB 00:01 2024-09-16T07:38:17.367 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T07:38:17.442 INFO:teuthology.orchestra.run.smithi137.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-16T07:38:17.551 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T07:38:17.591 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T07:38:17.609 INFO:teuthology.orchestra.run.smithi137.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 5.8 MB/s | 4.9 MB 00:00 2024-09-16T07:38:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T07:38:17.710 INFO:teuthology.orchestra.run.smithi137.stdout:(9/12): ceph-mgr-diskprediction-local-19.3.0-48 4.6 MB/s | 7.4 MB 00:01 2024-09-16T07:38:17.743 INFO:teuthology.orchestra.run.smithi137.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.8 MB/s | 250 kB 00:00 2024-09-16T07:38:18.315 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T07:38:18.445 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T07:38:19.252 INFO:teuthology.orchestra.run.smithi137.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.8 MB/s | 5.1 MB 00:01 2024-09-16T07:38:19.669 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T07:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:38:22.043 INFO:teuthology.orchestra.run.smithi137.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-16T07:38:22.044 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:22.045 INFO:teuthology.orchestra.run.smithi137.stdout:Total 6.2 MB/s | 38 MB 00:06 2024-09-16T07:38:22.401 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:22.429 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:22.429 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:22.857 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:22.857 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:23.338 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:38:23.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T07:38:23.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:38:23.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:38:23.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T07:38:23.339 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T07:38:23.339 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T07:38:23.339 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T07:38:23.339 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T07:38:23.339 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T07:38:23.340 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:38:23.340 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T07:38:23.610 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:23.689 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T07:38:23.733 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:38:23.814 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T07:38:23.815 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T07:38:23.816 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T07:38:23.816 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T07:38:23.816 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:23.816 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:23.833 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:38:23.884 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T07:38:24.069 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T07:38:24.108 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T07:38:24.184 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T07:38:24.220 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-rook 2024-09-16T07:38:24.793 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:58 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:24.826 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T07:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T07:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T07:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout:Install 13 Packages 2024-09-16T07:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 2.2 M 2024-09-16T07:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 26 M 2024-09-16T07:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:24.946 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T07:38:25.501 INFO:teuthology.orchestra.run.smithi170.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 326 kB/s | 26 kB 00:00 2024-09-16T07:38:25.526 INFO:teuthology.orchestra.run.smithi170.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 184 kB/s | 19 kB 00:00 2024-09-16T07:38:25.601 INFO:teuthology.orchestra.run.smithi170.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-09-16T07:38:25.626 INFO:teuthology.orchestra.run.smithi170.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-16T07:38:25.651 INFO:teuthology.orchestra.run.smithi170.stdout:(5/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 214 kB/s | 49 kB 00:00 2024-09-16T07:38:25.677 INFO:teuthology.orchestra.run.smithi170.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-16T07:38:25.702 INFO:teuthology.orchestra.run.smithi170.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-16T07:38:25.752 INFO:teuthology.orchestra.run.smithi170.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-16T07:38:25.778 INFO:teuthology.orchestra.run.smithi170.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 141 kB/s | 14 kB 00:00 2024-09-16T07:38:25.803 INFO:teuthology.orchestra.run.smithi170.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T07:38:25.828 INFO:teuthology.orchestra.run.smithi170.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-16T07:38:25.853 INFO:teuthology.orchestra.run.smithi170.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-16T07:38:25.929 INFO:teuthology.orchestra.run.smithi170.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.9 MB/s | 1.0 MB 00:00 2024-09-16T07:38:25.932 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:25.932 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.2 MB/s | 2.2 MB 00:01 2024-09-16T07:38:25.997 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:26.013 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:26.013 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:26.103 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:26.105 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:26.167 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:38:26.614 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:26.777 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T07:38:26.830 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T07:38:26.885 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T07:38:26.922 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T07:38:26.965 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T07:38:27.066 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T07:38:27.168 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T07:38:27.224 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T07:38:27.225 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T07:38:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:38:27.946 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T07:38:27.996 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T07:38:28.030 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T07:38:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T07:38:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:38:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T07:38:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T07:38:29.236 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T07:38:29.237 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T07:38:29.237 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T07:38:29.237 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T07:38:29.237 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T07:38:29.237 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T07:38:29.237 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T07:38:29.237 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:29.237 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:29.511 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T07:38:29.819 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-16T07:38:29.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-16T07:38:29.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T07:38:29.819 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T07:38:29.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T07:38:29.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T07:38:29.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T07:38:29.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T07:38:29.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T07:38:29.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T07:38:29.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T07:38:29.820 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T07:38:30.086 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:04 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:30.221 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T07:38:30.222 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:30.223 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:30.223 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:30.223 INFO:teuthology.orchestra.run.smithi170.stdout:Install 6 Packages 2024-09-16T07:38:30.223 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:30.223 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 7.0 M 2024-09-16T07:38:30.223 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 33 M 2024-09-16T07:38:30.224 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:30.273 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T07:38:30.273 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:30.273 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:30.274 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:30.677 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-rook 2024-09-16T07:38:30.748 INFO:teuthology.orchestra.run.smithi170.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 734 kB/s | 154 kB 00:00 2024-09-16T07:38:30.806 INFO:teuthology.orchestra.run.smithi170.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T07:38:30.831 INFO:teuthology.orchestra.run.smithi170.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-16T07:38:30.857 INFO:teuthology.orchestra.run.smithi170.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-16T07:38:31.174 INFO:teuthology.orchestra.run.smithi170.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 390 kB/s | 248 kB 00:00 2024-09-16T07:38:31.265 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:56 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:31.405 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T07:38:31.407 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout:Install 13 Packages 2024-09-16T07:38:31.408 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:31.409 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 2.2 M 2024-09-16T07:38:31.409 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 26 M 2024-09-16T07:38:31.409 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:32.065 INFO:teuthology.orchestra.run.smithi137.stdout:(1/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 303 kB/s | 49 kB 00:00 2024-09-16T07:38:32.448 INFO:teuthology.orchestra.run.smithi137.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 35 kB/s | 19 kB 00:00 2024-09-16T07:38:32.474 INFO:teuthology.orchestra.run.smithi137.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 45 kB/s | 26 kB 00:00 2024-09-16T07:38:32.574 INFO:teuthology.orchestra.run.smithi170.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.9 MB/s | 6.0 MB 00:02 2024-09-16T07:38:32.576 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:32.576 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.0 MB/s | 7.0 MB 00:02 2024-09-16T07:38:32.649 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:32.661 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:32.661 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:32.761 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:32.761 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:32.841 INFO:teuthology.orchestra.run.smithi137.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 286 kB/s | 222 kB 00:00 2024-09-16T07:38:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:33.182 INFO:teuthology.orchestra.run.smithi137.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 217 kB/s | 159 kB 00:00 2024-09-16T07:38:33.225 INFO:teuthology.orchestra.run.smithi137.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 778 kB/s | 32 kB 00:00 2024-09-16T07:38:33.250 INFO:teuthology.orchestra.run.smithi137.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 564 kB/s | 14 kB 00:00 2024-09-16T07:38:33.255 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T07:38:33.275 INFO:teuthology.orchestra.run.smithi137.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.6 MB/s | 220 kB 00:00 2024-09-16T07:38:33.308 INFO:teuthology.orchestra.run.smithi137.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 334 kB/s | 279 kB 00:00 2024-09-16T07:38:33.317 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T07:38:33.351 INFO:teuthology.orchestra.run.smithi137.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 14 MB/s | 1.0 MB 00:00 2024-09-16T07:38:33.376 INFO:teuthology.orchestra.run.smithi137.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-16T07:38:33.401 INFO:teuthology.orchestra.run.smithi137.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-09-16T07:38:33.434 INFO:teuthology.orchestra.run.smithi137.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 90 kB/s | 54 kB 00:00 2024-09-16T07:38:33.437 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:33.437 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.1 MB/s | 2.2 MB 00:02 2024-09-16T07:38:33.502 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:33.518 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:33.518 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:33.608 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:33.608 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T07:38:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T07:38:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T07:38:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:38:34.116 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:34.308 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T07:38:34.361 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T07:38:34.425 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T07:38:34.462 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T07:38:34.503 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T07:38:34.606 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T07:38:34.716 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T07:38:34.772 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T07:38:34.828 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:38:34.829 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T07:38:34.829 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T07:38:34.829 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T07:38:34.829 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T07:38:34.829 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T07:38:35.102 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T07:38:35.102 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:35.102 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:35.102 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:35.102 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T07:38:35.103 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T07:38:35.103 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T07:38:35.103 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T07:38:35.103 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T07:38:35.103 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:35.103 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:35.356 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-fuse 2024-09-16T07:38:35.500 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T07:38:35.552 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T07:38:35.585 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T07:38:35.634 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T07:38:35.655 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:38:35.929 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:09 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:36.063 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:36.064 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:36.064 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:38:36.064 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:36.064 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:36.064 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T07:38:36.064 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-16T07:38:36.064 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T07:38:36.065 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:36.065 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:36.065 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:36.065 INFO:teuthology.orchestra.run.smithi170.stdout:Install 2 Packages 2024-09-16T07:38:36.065 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:36.065 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 964 k 2024-09-16T07:38:36.065 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 4.1 M 2024-09-16T07:38:36.066 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:36.326 INFO:teuthology.orchestra.run.smithi170.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 540 kB/s | 80 kB 00:00 2024-09-16T07:38:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-16T07:38:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-16T07:38:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T07:38:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T07:38:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T07:38:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T07:38:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T07:38:36.426 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T07:38:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T07:38:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T07:38:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T07:38:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T07:38:36.427 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T07:38:36.476 INFO:teuthology.orchestra.run.smithi170.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 2.9 MB/s | 884 kB 00:00 2024-09-16T07:38:36.477 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:36.477 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.3 MB/s | 964 kB 00:00 2024-09-16T07:38:36.489 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:36.512 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:36.513 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:36.594 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:36.595 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:36.779 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T07:38:36.780 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T07:38:36.781 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T07:38:36.781 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T07:38:36.781 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:36.781 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:36.787 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:36.930 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T07:38:37.001 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:38:37.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T07:38:37.617 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:02 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:37.717 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:38:37.717 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T07:38:37.751 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:37.752 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:38:37.752 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:37.752 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-16T07:38:37.752 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:38:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T07:38:37.752 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T07:38:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T07:38:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T07:38:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T07:38:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:37.753 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:37.753 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:37.753 INFO:teuthology.orchestra.run.smithi137.stdout:Install 6 Packages 2024-09-16T07:38:37.753 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:37.754 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 7.0 M 2024-09-16T07:38:37.754 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 33 M 2024-09-16T07:38:37.754 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T07:38:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:38.001 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T07:38:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:38.002 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:38.044 INFO:teuthology.orchestra.run.smithi137.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-16T07:38:38.069 INFO:teuthology.orchestra.run.smithi137.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 651 kB/s | 154 kB 00:00 2024-09-16T07:38:38.120 INFO:teuthology.orchestra.run.smithi137.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-16T07:38:38.145 INFO:teuthology.orchestra.run.smithi137.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 766 kB/s | 58 kB 00:00 2024-09-16T07:38:38.170 INFO:teuthology.orchestra.run.smithi137.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-16T07:38:38.272 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-volume 2024-09-16T07:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:12 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:39.002 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:39.002 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 285 k 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 1.3 M 2024-09-16T07:38:39.003 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:39.215 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-16T07:38:39.215 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:39.215 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-16T07:38:39.216 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:39.224 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:39.224 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:39.251 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:39.251 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:39.469 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:39.541 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:39.558 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:39.577 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:38:39.577 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T07:38:39.577 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:40.362 INFO:teuthology.orchestra.run.smithi137.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-16T07:38:40.365 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:40.366 INFO:teuthology.orchestra.run.smithi137.stdout:Total 2.7 MB/s | 7.0 MB 00:02 2024-09-16T07:38:40.438 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:40.450 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:40.450 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:40.550 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:40.552 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:40.575 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:40.575 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:40.575 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:40.575 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:40.575 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:40.575 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:40.844 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados-devel 2024-09-16T07:38:40.860 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:41.028 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T07:38:41.080 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T07:38:41.431 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:15 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:41.569 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:41.570 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 125 k 2024-09-16T07:38:41.571 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 445 k 2024-09-16T07:38:41.571 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:41.600 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T07:38:41.683 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T07:38:41.754 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T07:38:41.778 INFO:teuthology.orchestra.run.smithi170.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 603 kB/s | 125 kB 00:00 2024-09-16T07:38:41.778 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:41.779 INFO:teuthology.orchestra.run.smithi170.stdout:Total 597 kB/s | 125 kB 00:00 2024-09-16T07:38:41.779 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:41.784 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:41.784 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:41.785 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:38:41.849 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:41.849 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:42.119 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:42.530 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-16T07:38:42.530 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-16T07:38:42.530 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T07:38:42.530 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T07:38:42.531 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T07:38:42.531 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T07:38:42.613 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:42.835 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:42.836 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:42.865 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:42.866 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:43.080 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs2 2024-09-16T07:38:43.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-fuse 2024-09-16T07:38:43.658 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:17 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:43.672 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:08 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:43.807 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:43.807 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:43.807 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:38:43.807 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:43.807 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:43.807 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-16T07:38:43.807 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-09-16T07:38:43.808 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T07:38:43.808 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:43.808 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:43.808 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:43.808 INFO:teuthology.orchestra.run.smithi137.stdout:Install 2 Packages 2024-09-16T07:38:43.808 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:43.808 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 964 k 2024-09-16T07:38:43.809 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 4.1 M 2024-09-16T07:38:43.809 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:43.872 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs-devel 2024-09-16T07:38:43.956 INFO:teuthology.orchestra.run.smithi137.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 642 kB/s | 80 kB 00:00 2024-09-16T07:38:44.131 INFO:teuthology.orchestra.run.smithi137.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 2.9 MB/s | 884 kB 00:00 2024-09-16T07:38:44.131 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:44.132 INFO:teuthology.orchestra.run.smithi137.stdout:Total 2.9 MB/s | 964 kB 00:00 2024-09-16T07:38:44.143 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:44.167 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:44.167 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:44.249 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:44.249 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:44.444 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:18 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:44.446 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:44.578 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 32 k 2024-09-16T07:38:44.579 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 142 k 2024-09-16T07:38:44.580 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:44.601 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T07:38:44.672 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:38:44.724 INFO:teuthology.orchestra.run.smithi170.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 220 kB/s | 32 kB 00:00 2024-09-16T07:38:44.725 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:44.725 INFO:teuthology.orchestra.run.smithi170.stdout:Total 218 kB/s | 32 kB 00:00 2024-09-16T07:38:44.725 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:44.729 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:44.729 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:44.749 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:44.750 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:44.831 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:44.929 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:45.268 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:45.399 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-16T07:38:45.399 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-16T07:38:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:45.508 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:45.508 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T07:38:45.721 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:45.721 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T07:38:45.722 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:45.722 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:45.737 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados2 2024-09-16T07:38:46.031 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-volume 2024-09-16T07:38:46.308 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:20 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:46.399 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:46.442 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:46.443 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:38:46.443 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:46.521 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librbd1 2024-09-16T07:38:46.610 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:11 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:46.746 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:46.747 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:46.747 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-09-16T07:38:46.747 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 285 k 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 1.3 M 2024-09-16T07:38:46.748 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:46.960 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-16T07:38:46.961 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:46.961 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-16T07:38:46.961 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:46.969 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:46.969 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:46.997 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:46.997 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:47.090 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:21 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:47.180 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:47.218 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:47.224 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:47.225 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:38:47.225 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:47.287 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:47.303 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rados 2024-09-16T07:38:47.303 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:47.303 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:38:47.304 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T07:38:47.304 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:47.874 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:21 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:47.967 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:48.011 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:48.012 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:38:48.012 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:48.086 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rgw 2024-09-16T07:38:48.319 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-16T07:38:48.320 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:48.320 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:48.320 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-16T07:38:48.320 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:48.320 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:48.604 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados-devel 2024-09-16T07:38:48.654 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:22 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:48.746 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:48.790 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:48.790 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:38:48.791 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:48.886 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-cephfs 2024-09-16T07:38:49.179 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:14 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:49.316 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:49.317 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:49.317 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-09-16T07:38:49.317 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:49.317 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:49.317 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-16T07:38:49.318 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:49.318 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:49.318 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:49.318 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-09-16T07:38:49.318 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:49.318 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 125 k 2024-09-16T07:38:49.318 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 445 k 2024-09-16T07:38:49.318 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:49.453 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:23 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:49.507 INFO:teuthology.orchestra.run.smithi137.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 662 kB/s | 125 kB 00:00 2024-09-16T07:38:49.507 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:49.507 INFO:teuthology.orchestra.run.smithi137.stdout:Total 657 kB/s | 125 kB 00:00 2024-09-16T07:38:49.508 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:49.513 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:49.513 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:49.544 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:49.577 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:49.577 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:49.589 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:49.590 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:38:49.590 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:49.672 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rbd 2024-09-16T07:38:49.745 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:49.846 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:50.237 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:24 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:50.277 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:50.328 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:50.371 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:50.372 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-09-16T07:38:50.372 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:50.451 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-fuse 2024-09-16T07:38:50.547 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:50.547 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:50.547 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:50.547 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:50.547 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:50.547 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:50.758 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install libcephfs2 2024-09-16T07:38:51.053 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:25 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:51.194 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:51.195 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:51.195 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-16T07:38:51.195 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 91 k 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 321 k 2024-09-16T07:38:51.196 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:51.333 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:16 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:51.385 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 482 kB/s | 91 kB 00:00 2024-09-16T07:38:51.386 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:51.386 INFO:teuthology.orchestra.run.smithi170.stdout:Total 478 kB/s | 91 kB 00:00 2024-09-16T07:38:51.386 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:51.395 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:51.395 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:51.423 INFO:teuthology.orchestra.run.smithi137.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:51.461 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:51.461 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:51.466 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:51.467 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:38:51.468 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:51.571 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install libcephfs-devel 2024-09-16T07:38:51.614 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:51.734 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:52.086 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:52.137 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:17 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:52.271 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:52.272 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:52.272 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-09-16T07:38:52.272 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 32 k 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 142 k 2024-09-16T07:38:52.273 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:52.427 INFO:teuthology.orchestra.run.smithi137.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 207 kB/s | 32 kB 00:00 2024-09-16T07:38:52.427 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:52.427 INFO:teuthology.orchestra.run.smithi137.stdout:Total 205 kB/s | 32 kB 00:00 2024-09-16T07:38:52.428 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:52.431 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:52.431 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:52.450 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:52.450 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:52.540 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:52.621 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-mirror 2024-09-16T07:38:52.656 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:53.035 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:53.201 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:27 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:53.275 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:53.275 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:53.275 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:38:53.275 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:53.275 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:53.276 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:53.341 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:53.342 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:53.342 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-09-16T07:38:53.342 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:53.342 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:53.342 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:38:53.342 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:53.342 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:53.343 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:53.343 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-16T07:38:53.343 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:53.343 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 3.5 M 2024-09-16T07:38:53.343 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 30 M 2024-09-16T07:38:53.343 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:53.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados2 2024-09-16T07:38:53.681 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2024-09-16T07:38:53.681 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:53.682 INFO:teuthology.orchestra.run.smithi170.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-16T07:38:53.682 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:53.693 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:53.693 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:53.777 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:53.777 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:54.036 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:19 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:54.127 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:54.170 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:54.171 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:38:54.171 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:54.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librbd1 2024-09-16T07:38:54.369 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:54.432 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:54.457 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:54.457 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:38:54.457 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T07:38:54.457 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:38:54.457 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:38:54.457 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:54.814 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:19 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:54.905 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:54.949 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:54.950 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:38:54.950 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:55.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rados 2024-09-16T07:38:55.598 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:20 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:55.682 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:55.682 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:55.682 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:55.683 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:55.683 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:55.683 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:55.690 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:55.734 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:55.735 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:38:55.735 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:55.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rgw 2024-09-16T07:38:55.934 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-nbd 2024-09-16T07:38:56.367 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:21 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:56.457 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:56.500 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:56.502 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:38:56.502 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:56.516 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:02:30 ago on Mon 16 Sep 2024 07:36:26 AM UTC. 2024-09-16T07:38:56.575 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-cephfs 2024-09-16T07:38:56.650 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-16T07:38:56.651 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-09-16T07:38:56.652 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:56.652 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 177 k 2024-09-16T07:38:56.652 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 685 k 2024-09-16T07:38:56.652 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-16T07:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 849 kB/s | 177 kB 00:00 2024-09-16T07:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout:Total 844 kB/s | 177 kB 00:00 2024-09-16T07:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-16T07:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-16T07:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-16T07:38:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-16T07:38:56.939 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-16T07:38:57.097 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-16T07:38:57.140 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:22 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:57.231 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:57.275 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:57.276 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:38:57.276 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:57.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rbd 2024-09-16T07:38:57.598 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:57.867 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:57.867 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:57.867 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-16T07:38:57.867 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:38:57.868 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:38:57.868 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-16T07:38:57.909 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:22 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:58.001 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-16T07:38:58.045 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:58.046 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-09-16T07:38:58.046 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:38:58.127 DEBUG:teuthology.parallel:result is None 2024-09-16T07:38:58.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-fuse 2024-09-16T07:38:58.691 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:23 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:38:58.824 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:38:58.825 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 91 k 2024-09-16T07:38:58.826 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 321 k 2024-09-16T07:38:58.826 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:38:59.012 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 487 kB/s | 91 kB 00:00 2024-09-16T07:38:59.013 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:38:59.013 INFO:teuthology.orchestra.run.smithi137.stdout:Total 484 kB/s | 91 kB 00:00 2024-09-16T07:38:59.013 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:38:59.022 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:38:59.022 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:38:59.085 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:38:59.085 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:38:59.237 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:38:59.335 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:38:59.767 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:39:00.017 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:39:00.017 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:00.017 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:39:00.017 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:39:00.017 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:00.018 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:39:00.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-mirror 2024-09-16T07:39:00.900 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:25 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:39:01.047 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-09-16T07:39:01.048 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:01.049 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 3.5 M 2024-09-16T07:39:01.049 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 30 M 2024-09-16T07:39:01.049 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:39:01.374 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2024-09-16T07:39:01.375 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:39:01.376 INFO:teuthology.orchestra.run.smithi137.stdout:Total 11 MB/s | 3.5 MB 00:00 2024-09-16T07:39:01.376 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:39:01.395 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:39:01.395 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:39:01.494 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:39:01.494 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:39:02.101 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:39:02.150 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:39:02.177 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:39:02.177 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T07:39:02.177 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T07:39:02.177 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:39:02.177 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T07:39:02.177 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:03.424 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:39:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:03.425 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:39:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:39:03.425 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:03.425 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:39:03.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-nbd 2024-09-16T07:39:04.246 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:02:29 ago on Mon 16 Sep 2024 07:36:35 AM UTC. 2024-09-16T07:39:04.385 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-09-16T07:39:04.385 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:39:04.385 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-09-16T07:39:04.385 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:39:04.385 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-09-16T07:39:04.386 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-16T07:39:04.386 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:04.386 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-09-16T07:39:04.386 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-09-16T07:39:04.386 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-09-16T07:39:04.386 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:04.387 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 177 k 2024-09-16T07:39:04.387 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 685 k 2024-09-16T07:39:04.387 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-09-16T07:39:04.594 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 851 kB/s | 177 kB 00:00 2024-09-16T07:39:04.595 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-09-16T07:39:04.595 INFO:teuthology.orchestra.run.smithi137.stdout:Total 844 kB/s | 177 kB 00:00 2024-09-16T07:39:04.596 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-09-16T07:39:04.605 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-09-16T07:39:04.605 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-09-16T07:39:04.673 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-09-16T07:39:04.674 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-09-16T07:39:04.863 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-09-16T07:39:04.967 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:39:05.383 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:39:05.641 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-16T07:39:05.642 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:05.642 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-09-16T07:39:05.642 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-16T07:39:05.642 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:05.642 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-09-16T07:39:05.917 DEBUG:teuthology.parallel:result is None 2024-09-16T07:39:05.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:39:06.070 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T07:39:06.092 INFO:teuthology.orchestra.run.smithi137.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T07:39:06.092 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T07:39:06.093 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T07:39:06.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-16T07:39:06.234 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T07:39:06.259 INFO:teuthology.orchestra.run.smithi170.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-16T07:39:06.259 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-16T07:39:06.259 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-16T07:39:06.261 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T07:39:06.262 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:06.262 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:39:06.287 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:06.287 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T07:39:06.329 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T07:39:06.329 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:06.329 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:39:06.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:39:06.420 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:06.420 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T07:39:06.448 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T07:39:06.515 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T07:39:06.515 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:06.515 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:39:06.540 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:39:06.605 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:06.605 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T07:39:06.632 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T07:39:06.698 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T07:39:06.698 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:06.698 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:39:06.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:39:06.791 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:06.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T07:39:06.817 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T07:39:06.882 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T07:39:06.987 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T07:39:06.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-09-16T07:39:06.990 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-09-16T07:39:07.015 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T07:39:07.015 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:39:07.055 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T07:39:07.079 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T07:39:07.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:39:07.121 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T07:39:07.155 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T07:39:07.155 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T07:39:07.155 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency}', 'email': None, 'first_in_suite': False, 'job_id': '7906867', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6651, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSupPkO5uBzRNu2N65pBZTPo2M0JljQzXlAk5hAihF7Htue2+y+2r/6gM9v+58tE7/MYTwke73z7qI2rzpWP7I=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHGydHGsAZEXB6RSBQfBUAdTKZJNJDnWQqWCywleM6A20yKvTdRk+Z8A0uXFd0FKaroD0jtLNyZPesTI7CgG0I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'concurrency': 128, 'size': 8192, 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-16_07:15:55', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T07:39:07.156 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:39:07.398 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T07:39:07.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:39:07.454 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T07:39:07.479 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:07.479 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:39:07.533 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:39:07.533 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-16 07:39:02.441249663 +0000 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-16 07:35:46.716884765 +0000 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-16 07:35:46.716884765 +0000 2024-09-16T07:39:07.590 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-16 07:35:46.716884765 +0000 2024-09-16T07:39:07.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:39:07.653 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-16T07:39:07.653 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-16T07:39:07.653 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000271557 s, 1.9 MB/s 2024-09-16T07:39:07.655 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:39:07.712 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-09-16T07:39:07.767 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:39:07.767 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:39:07.768 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T07:39:07.768 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:39:07.768 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:39:07.768 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-16 07:39:02.441249663 +0000 2024-09-16T07:39:07.768 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-16 07:35:47.037879256 +0000 2024-09-16T07:39:07.768 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-16 07:35:47.037879256 +0000 2024-09-16T07:39:07.768 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-16 07:35:47.037879256 +0000 2024-09-16T07:39:07.768 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:39:07.830 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-16T07:39:07.830 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-16T07:39:07.830 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000226207 s, 2.3 MB/s 2024-09-16T07:39:07.831 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:39:07.887 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-09-16T07:39:07.942 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:39:07.942 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:39:07.943 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-16T07:39:07.943 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:39:07.943 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:39:07.943 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-16 07:39:02.442249646 +0000 2024-09-16T07:39:07.943 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-16 07:35:47.381873353 +0000 2024-09-16T07:39:07.943 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-16 07:35:47.381873353 +0000 2024-09-16T07:39:07.943 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-16 07:35:47.381873353 +0000 2024-09-16T07:39:07.943 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:39:08.005 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-16T07:39:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-16T07:39:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000264682 s, 1.9 MB/s 2024-09-16T07:39:08.007 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:39:08.063 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-09-16T07:39:08.118 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:39:08.118 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:39:08.118 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T07:39:08.118 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:39:08.119 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:39:08.119 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-09-16 07:39:02.442249646 +0000 2024-09-16T07:39:08.119 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-09-16 07:35:47.705867794 +0000 2024-09-16T07:39:08.119 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-09-16 07:35:47.705867794 +0000 2024-09-16T07:39:08.119 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-09-16 07:35:47.705867794 +0000 2024-09-16T07:39:08.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:39:08.181 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-09-16T07:39:08.182 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-09-16T07:39:08.182 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000181576 s, 2.8 MB/s 2024-09-16T07:39:08.183 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:39:08.239 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:39:08.239 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:08.239 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T07:39:08.257 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T07:39:08.258 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-09-16T07:39:08.313 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T07:39:08.314 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:39:08.314 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T07:39:08.314 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:39:08.314 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:39:08.314 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-16 07:38:54.728220671 +0000 2024-09-16T07:39:08.314 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-16 07:35:45.018344072 +0000 2024-09-16T07:39:08.314 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-16 07:35:45.018344072 +0000 2024-09-16T07:39:08.314 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-16 07:35:45.018344072 +0000 2024-09-16T07:39:08.314 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T07:39:08.379 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-16T07:39:08.379 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-16T07:39:08.379 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.8264e-05 s, 5.8 MB/s 2024-09-16T07:39:08.380 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T07:39:08.437 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-09-16T07:39:08.493 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T07:39:08.493 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:39:08.494 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-16T07:39:08.494 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:39:08.494 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:39:08.494 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-16 07:38:54.728220671 +0000 2024-09-16T07:39:08.494 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-16 07:35:45.336336682 +0000 2024-09-16T07:39:08.494 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-16 07:35:45.336336682 +0000 2024-09-16T07:39:08.494 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-16 07:35:45.336336682 +0000 2024-09-16T07:39:08.494 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T07:39:08.557 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-16T07:39:08.557 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-16T07:39:08.557 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.6523e-05 s, 5.9 MB/s 2024-09-16T07:39:08.559 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T07:39:08.616 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-16 07:38:54.728220671 +0000 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-16 07:35:45.650329385 +0000 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-16 07:35:45.650329385 +0000 2024-09-16T07:39:08.672 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-16 07:35:45.650329385 +0000 2024-09-16T07:39:08.673 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T07:39:08.735 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-16T07:39:08.736 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-16T07:39:08.736 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.7931e-05 s, 5.2 MB/s 2024-09-16T07:39:08.737 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T07:39:08.793 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-09-16T07:39:08.848 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T07:39:08.848 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T07:39:08.848 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T07:39:08.849 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T07:39:08.849 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T07:39:08.849 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-16 07:38:54.729220648 +0000 2024-09-16T07:39:08.849 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-16 07:35:45.963322111 +0000 2024-09-16T07:39:08.849 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-16 07:35:45.963322111 +0000 2024-09-16T07:39:08.849 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-16 07:35:45.963322111 +0000 2024-09-16T07:39:08.849 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T07:39:08.911 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-16T07:39:08.911 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-16T07:39:08.911 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000101675 s, 5.0 MB/s 2024-09-16T07:39:08.912 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T07:39:08.971 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:39:08.971 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T07:39:08.972 INFO:tasks.ceph:Generating config... 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T07:39:08.973 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] log to file = False 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-16T07:39:08.974 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T07:39:08.975 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-16T07:39:08.975 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-16T07:39:08.975 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T07:39:08.975 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-16T07:39:08.975 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-16T07:39:08.975 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T07:39:08.975 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-16T07:39:08.975 INFO:tasks.ceph:[client.0] debug ms = 1 2024-09-16T07:39:08.975 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-16T07:39:08.975 INFO:tasks.ceph:[client.0] debug rados = 20 2024-09-16T07:39:08.975 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:39:08.975 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-16T07:39:08.975 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-16T07:39:08.975 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-16T07:39:08.975 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-16T07:39:08.976 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-16T07:39:08.976 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-16T07:39:08.976 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-16T07:39:08.976 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T07:39:08.976 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T07:39:08.977 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-16T07:39:08.977 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T07:39:08.977 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-16T07:39:08.977 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-16T07:39:08.977 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-16T07:39:08.977 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-16T07:39:08.977 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T07:39:08.977 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T07:39:09.038 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T07:39:09.041 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T07:39:09.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:39:09.118 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.137')] 2024-09-16T07:39:09.118 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.137', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-16T07:39:09.119 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:09.119 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:39:09.173 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.137 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:09.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:09.264+0000 7fda3671af00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:09.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:09.264+0000 7fda3671af00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:09.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:09.265+0000 7fda3671af00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:09.265 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:09.265 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: generated fsid ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803 2024-09-16T07:39:09.265 INFO:teuthology.orchestra.run.smithi137.stdout:setting min_mon_release = quincy 2024-09-16T07:39:09.265 INFO:teuthology.orchestra.run.smithi137.stdout:epoch 0 2024-09-16T07:39:09.265 INFO:teuthology.orchestra.run.smithi137.stdout:fsid ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803 2024-09-16T07:39:09.265 INFO:teuthology.orchestra.run.smithi137.stdout:last_changed 2024-09-16T07:39:09.266157+0000 2024-09-16T07:39:09.265 INFO:teuthology.orchestra.run.smithi137.stdout:created 2024-09-16T07:39:09.266157+0000 2024-09-16T07:39:09.266 INFO:teuthology.orchestra.run.smithi137.stdout:min_mon_release 17 (quincy) 2024-09-16T07:39:09.266 INFO:teuthology.orchestra.run.smithi137.stdout:election_strategy: 1 2024-09-16T07:39:09.266 INFO:teuthology.orchestra.run.smithi137.stdout:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-09-16T07:39:09.266 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-16T07:39:09.267 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T07:39:09.282 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803... 2024-09-16T07:39:09.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:39:09.325 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-09-16T07:39:09.365 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.366 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:39:09.367 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = 172.21.15.137 2024-09-16T07:39:09.368 INFO:teuthology.orchestra.run.smithi137.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: ms client mode = crc 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: ms cluster mode = crc 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: ms mon client mode = crc 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: ms mon cluster mode = crc 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: ms mon service mode = crc 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: ms service mode = crc 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_min_size = 2 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_size = 3 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-09-16T07:39:09.369 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 120 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-09-16T07:39:09.370 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-09-16T07:39:09.371 INFO:teuthology.orchestra.run.smithi137.stdout: debug monc = 20 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore compression algorithm = snappy 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore compression mode = aggressive 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore rocksdb cf = False 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: crimson osd obc lru size = 10 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 20 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 20 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 10 2024-09-16T07:39:09.372 INFO:teuthology.orchestra.run.smithi137.stdout: err to stderr = True 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: log flush on exit = True 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: log to file = False 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: log to stderr = True 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: osd blocked scrub grace period = 3600 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug reject backfill probability = 0.3 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: osd delete sleep = 1 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: osd max backfills = 3 2024-09-16T07:39:09.373 INFO:teuthology.orchestra.run.smithi137.stdout: osd max markdown count = 1000 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub min interval = 60 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: osd shutdown pgref assert = True 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: osd snap trim sleep = 2 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:39:09.374 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: mgr stats period = 30 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-09-16T07:39:09.375 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:39:09.376 INFO:teuthology.orchestra.run.smithi137.stdout: mon min osdmap epochs = 50 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune interval = 2 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune min = 15 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: mon osdmap full prune txsize = 2 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default crimson = True 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: paxos service trim min = 10 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:39:09.377 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: debug objecter = 20 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: debug rados = 20 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-09-16T07:39:09.378 INFO:teuthology.orchestra.run.smithi137.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:39:09.380 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-09-16T07:39:09.380 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-09-16T07:39:09.380 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T07:39:09.380 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-09-16T07:39:09.380 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.380 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-09-16T07:39:09.380 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.381 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-09-16T07:39:09.382 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = 172.21.15.137 2024-09-16T07:39:09.383 INFO:teuthology.orchestra.run.smithi170.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: ms client mode = crc 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: ms cluster mode = crc 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: ms mon client mode = crc 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: ms mon cluster mode = crc 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: ms mon service mode = crc 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: ms service mode = crc 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_min_size = 2 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_size = 3 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-09-16T07:39:09.384 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 120 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-09-16T07:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: debug monc = 20 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore compression algorithm = snappy 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore compression mode = aggressive 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore rocksdb cf = False 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: crimson alien thread cpu cores = 6-7 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: crimson osd obc lru size = 10 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 20 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 20 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-09-16T07:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 10 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: err to stderr = True 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: log flush on exit = True 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: log to file = False 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: log to stderr = True 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: osd blocked scrub grace period = 3600 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug reject backfill probability = 0.3 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: osd delete sleep = 1 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: osd max backfills = 3 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: osd max markdown count = 1000 2024-09-16T07:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub min interval = 60 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: osd shutdown pgref assert = True 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: osd snap trim sleep = 2 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: mgr stats period = 30 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-09-16T07:39:09.390 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-09-16T07:39:09.391 INFO:teuthology.orchestra.run.smithi170.stdout: mon min osdmap epochs = 50 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: mon osdmap full prune interval = 2 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: mon osdmap full prune min = 15 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: mon osdmap full prune txsize = 2 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default crimson = True 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: paxos service trim min = 10 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-09-16T07:39:09.392 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout: debug objecter = 20 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout: debug rados = 20 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout: crimson seastar cpu cores = 0-2 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2024-09-16T07:39:09.393 INFO:teuthology.orchestra.run.smithi170.stdout: crimson seastar cpu cores = 3-5 2024-09-16T07:39:09.393 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T07:39:09.394 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T07:39:09.485 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T07:39:09.485 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:09.485 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T07:39:09.501 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:09.501 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T07:39:09.555 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T07:39:09.555 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:09.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:39:09.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:39:09.629 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:09.629 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:09.685 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-09-16T07:39:09.685 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:09.685 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T07:39:09.685 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T07:39:09.720 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:09.720 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:09.775 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T07:39:09.775 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T07:39:09.775 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:39:09.906 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T07:39:09.909 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T07:39:09.909 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T07:39:09.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T07:39:09.959 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T07:39:09.973 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T07:39:10.023 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T07:39:10.037 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T07:39:10.037 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-16T07:39:10.037 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T07:39:10.062 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:39:10.062 INFO:tasks.ceph:role: osd.0 2024-09-16T07:39:10.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T07:39:10.062 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:39:10.134 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:39:10.134 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:39:10.135 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:39:10.641 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-16T07:39:10.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-16T07:39:10.643 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T07:39:10.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T07:39:10.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T07:39:10.877 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-16T07:39:10.877 INFO:tasks.ceph:role: osd.1 2024-09-16T07:39:10.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T07:39:10.878 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:39:10.950 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:39:10.951 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:39:11.399 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-09-16T07:39:11.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-09-16T07:39:11.401 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T07:39:11.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T07:39:11.522 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:11.820 INFO:teuthology.orchestra.run.smithi137.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:39:11.821 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-09-16 07:39:11,823 seastar - Reactor backend: linux-aio 2024-09-16T07:39:11.832 INFO:teuthology.orchestra.run.smithi137.stderr:==27755==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:39:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-09-16 07:39:11,958 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:39:11.956 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-09-16 07:39:11,958 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T07:39:11.957 INFO:teuthology.orchestra.run.smithi137.stderr:DEBUG 2024-09-16 07:39:11,959 [shard 0:main] seastar - reactor::drain 2024-09-16T07:39:12.474 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-09-16T07:39:12.475 INFO:teuthology.orchestra.run.smithi137.stderr:Suppressions used: 2024-09-16T07:39:12.475 INFO:teuthology.orchestra.run.smithi137.stderr: count bytes template 2024-09-16T07:39:12.475 INFO:teuthology.orchestra.run.smithi137.stderr: 1 8 MallocExtension::Register 2024-09-16T07:39:12.475 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-09-16T07:39:12.475 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:39:12.529 INFO:teuthology.orchestra.run.smithi137.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:39:12.533 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-09-16 07:39:12,534 seastar - Reactor backend: linux-aio 2024-09-16T07:39:12.542 INFO:teuthology.orchestra.run.smithi137.stderr:==27753==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:39:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-09-16T07:39:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:Suppressions used: 2024-09-16T07:39:17.219 INFO:teuthology.orchestra.run.smithi137.stderr: count bytes template 2024-09-16T07:39:17.219 INFO:teuthology.orchestra.run.smithi137.stderr: 1 8 MallocExtension::Register 2024-09-16T07:39:17.219 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-09-16T07:39:17.219 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:39:17.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T07:39:17.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:17.545 INFO:teuthology.orchestra.run.smithi137.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:39:17.546 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-09-16 07:39:17,547 seastar - Reactor backend: linux-aio 2024-09-16T07:39:17.551 INFO:teuthology.orchestra.run.smithi137.stderr:==27941==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:39:17.658 INFO:teuthology.orchestra.run.smithi137.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x156e8 0xdd312 0x4ab1c 0x3817ea5 0x4621ee0 0x5fdbff1 0x5fdc222 0x5fb92bb 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:39:17.658 INFO:teuthology.orchestra.run.smithi137.stderr:kernel callstack: 2024-09-16T07:39:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-09-16 07:39:17,676 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:39:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-09-16 07:39:17,677 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T07:39:17.676 INFO:teuthology.orchestra.run.smithi137.stderr:DEBUG 2024-09-16 07:39:17,677 [shard 0:main] seastar - reactor::drain 2024-09-16T07:39:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-09-16T07:39:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:Suppressions used: 2024-09-16T07:39:18.193 INFO:teuthology.orchestra.run.smithi137.stderr: count bytes template 2024-09-16T07:39:18.193 INFO:teuthology.orchestra.run.smithi137.stderr: 1 8 MallocExtension::Register 2024-09-16T07:39:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-09-16T07:39:18.193 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:39:18.255 INFO:teuthology.orchestra.run.smithi137.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:39:18.259 INFO:teuthology.orchestra.run.smithi137.stderr:INFO 2024-09-16 07:39:18,260 seastar - Reactor backend: linux-aio 2024-09-16T07:39:18.279 INFO:teuthology.orchestra.run.smithi137.stderr:==27939==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:39:18.344 INFO:teuthology.orchestra.run.smithi137.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797f 0xdd2e1 0x4ab1c 0x5fe9be6 0x5fe9ea6 0x5fe9fdf 0x5fea2b5 0x60389b3 0x6038bb9 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:39:18.344 INFO:teuthology.orchestra.run.smithi137.stderr:kernel callstack: 2024-09-16T07:39:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-09-16T07:39:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:Suppressions used: 2024-09-16T07:39:23.230 INFO:teuthology.orchestra.run.smithi137.stderr: count bytes template 2024-09-16T07:39:23.230 INFO:teuthology.orchestra.run.smithi137.stderr: 1 8 MallocExtension::Register 2024-09-16T07:39:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:----------------------------------------------------- 2024-09-16T07:39:23.230 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:39:23.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T07:39:23.277 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T07:39:23.308 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:39:23.308 INFO:tasks.ceph:role: osd.2 2024-09-16T07:39:23.308 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-16T07:39:23.308 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T07:39:23.377 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:39:23.377 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:39:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:39:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:39:23.378 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:39:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:39:23.378 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:39:23.378 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:39:23.378 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:39:23.378 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:39:23.410 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-16T07:39:23.412 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-16T07:39:23.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-16T07:39:23.482 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T07:39:23.554 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T07:39:23.622 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-16T07:39:23.622 INFO:tasks.ceph:role: osd.3 2024-09-16T07:39:23.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-16T07:39:23.622 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T07:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T07:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-16T07:39:23.723 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-16T07:39:23.723 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-16T07:39:23.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T07:39:23.863 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:24.190 INFO:teuthology.orchestra.run.smithi170.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:39:24.191 INFO:teuthology.orchestra.run.smithi170.stderr:INFO 2024-09-16 07:39:24,193 seastar - Reactor backend: linux-aio 2024-09-16T07:39:24.210 INFO:teuthology.orchestra.run.smithi170.stderr:==27638==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:39:24.457 INFO:teuthology.orchestra.run.smithi170.stderr:INFO 2024-09-16 07:39:24,459 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:39:24.457 INFO:teuthology.orchestra.run.smithi170.stderr:INFO 2024-09-16 07:39:24,459 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-16T07:39:24.459 INFO:teuthology.orchestra.run.smithi170.stderr:DEBUG 2024-09-16 07:39:24,460 [shard 0:main] seastar - reactor::drain 2024-09-16T07:39:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:----------------------------------------------------- 2024-09-16T07:39:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:Suppressions used: 2024-09-16T07:39:25.216 INFO:teuthology.orchestra.run.smithi170.stderr: count bytes template 2024-09-16T07:39:25.216 INFO:teuthology.orchestra.run.smithi170.stderr: 1 8 MallocExtension::Register 2024-09-16T07:39:25.216 INFO:teuthology.orchestra.run.smithi170.stderr:----------------------------------------------------- 2024-09-16T07:39:25.216 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-16T07:39:25.274 INFO:teuthology.orchestra.run.smithi170.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:39:25.278 INFO:teuthology.orchestra.run.smithi170.stderr:INFO 2024-09-16 07:39:25,279 seastar - Reactor backend: linux-aio 2024-09-16T07:39:25.287 INFO:teuthology.orchestra.run.smithi170.stderr:==27628==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:39:25.352 INFO:teuthology.orchestra.run.smithi170.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10796f 0xdd305 0x4b7ec 0x5fdd832 0x5fdd905 0x6038b24 0x5fb8d06 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-16T07:39:25.352 INFO:teuthology.orchestra.run.smithi170.stderr:kernel callstack: 2024-09-16T07:39:29.968 INFO:teuthology.orchestra.run.smithi170.stderr:----------------------------------------------------- 2024-09-16T07:39:29.968 INFO:teuthology.orchestra.run.smithi170.stderr:Suppressions used: 2024-09-16T07:39:29.969 INFO:teuthology.orchestra.run.smithi170.stderr: count bytes template 2024-09-16T07:39:29.969 INFO:teuthology.orchestra.run.smithi170.stderr: 1 8 MallocExtension::Register 2024-09-16T07:39:29.969 INFO:teuthology.orchestra.run.smithi170.stderr:----------------------------------------------------- 2024-09-16T07:39:29.969 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-16T07:39:29.991 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T07:39:30.017 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:30.305 INFO:teuthology.orchestra.run.smithi170.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:39:30.306 INFO:teuthology.orchestra.run.smithi170.stderr:INFO 2024-09-16 07:39:30,308 seastar - Reactor backend: linux-aio 2024-09-16T07:39:30.311 INFO:teuthology.orchestra.run.smithi170.stderr:==27827==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:39:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:INFO 2024-09-16 07:39:30,437 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-16T07:39:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:INFO 2024-09-16 07:39:30,437 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-16T07:39:30.436 INFO:teuthology.orchestra.run.smithi170.stderr:DEBUG 2024-09-16 07:39:30,438 [shard 0:main] seastar - reactor::drain 2024-09-16T07:39:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:----------------------------------------------------- 2024-09-16T07:39:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:Suppressions used: 2024-09-16T07:39:30.942 INFO:teuthology.orchestra.run.smithi170.stderr: count bytes template 2024-09-16T07:39:30.942 INFO:teuthology.orchestra.run.smithi170.stderr: 1 8 MallocExtension::Register 2024-09-16T07:39:30.942 INFO:teuthology.orchestra.run.smithi170.stderr:----------------------------------------------------- 2024-09-16T07:39:30.942 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-16T07:39:31.003 INFO:teuthology.orchestra.run.smithi170.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-16T07:39:31.007 INFO:teuthology.orchestra.run.smithi170.stderr:INFO 2024-09-16 07:39:31,008 seastar - Reactor backend: linux-aio 2024-09-16T07:39:31.021 INFO:teuthology.orchestra.run.smithi170.stderr:==27825==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-16T07:39:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:----------------------------------------------------- 2024-09-16T07:39:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:Suppressions used: 2024-09-16T07:39:35.959 INFO:teuthology.orchestra.run.smithi170.stderr: count bytes template 2024-09-16T07:39:35.959 INFO:teuthology.orchestra.run.smithi170.stderr: 1 8 MallocExtension::Register 2024-09-16T07:39:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:----------------------------------------------------- 2024-09-16T07:39:35.960 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-16T07:39:35.981 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T07:39:36.006 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T07:39:36.007 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:36.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T07:39:36.037 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:36.037 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T07:39:36.106 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:36.107 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T07:39:36.131 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:36.132 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T07:39:36.196 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:36.197 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T07:39:36.261 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:36.262 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T07:39:36.280 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:36.280 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T07:39:36.317 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T07:39:36.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T07:39:36.347 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-09-16T07:39:36.348 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCg4OdmaHA1KRAANDrINhUF6OOXtZlAg0QPKA== 2024-09-16T07:39:36.348 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-09-16T07:39:36.348 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCm4OdmEHSFGRAAO5Ky7FXtCIPxTFodLEk6aw== 2024-09-16T07:39:36.348 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-09-16T07:39:36.348 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCd4OdmaoYaNhAAJVrd/Z5czFn/SGU9nQFBDQ== 2024-09-16T07:39:36.349 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-09-16T07:39:36.349 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCt4Odmk2X0GRAAW2Pta96QZwsOe1ni9kyD7g== 2024-09-16T07:39:36.349 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-09-16T07:39:36.349 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCz4OdmIZIGChAATio59I4y/P7pgA0a7gI/Gg== 2024-09-16T07:39:36.349 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-09-16T07:39:36.349 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCd4OdmR85MORAAI1FzOZ4UiEd9AuK2zliOXA== 2024-09-16T07:39:36.352 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-09-16T07:39:36.352 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQCe4Odm3L98ARAAoSI096WbfqhiukER1yILXA== 2024-09-16T07:39:36.353 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:39:36.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:39:36.527 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T07:39:36.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:39:36.648 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T07:39:36.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:39:36.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T07:39:36.839 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T07:39:36.839 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T07:39:36.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T07:39:36.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:36.975+0000 7f821222dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:36.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:36.975+0000 7f821222dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:36.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T07:39:37.017 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T07:39:37.072 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T07:39:37.073 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T07:39:37.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T07:39:37.115 INFO:tasks.ceph.mon.a:Started 2024-09-16T07:39:37.115 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T07:39:37.115 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T07:39:37.115 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T07:39:37.118 INFO:tasks.ceph.mgr.x:Started 2024-09-16T07:39:37.118 DEBUG:tasks.ceph:set 0 configs 2024-09-16T07:39:37.118 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T07:39:37.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T07:39:37.195 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-09-16T07:39:37.196+0000 7f6bb843ec00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.196 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-09-16T07:39:37.196+0000 7f6bb843ec00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.196 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-09-16T07:39:37.196+0000 7f6bb843ec00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.216 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-09-16T07:39:37.216+0000 7f9237dcb000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:37.222+0000 7fc6700fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.239 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-09-16T07:39:37.239+0000 7f9237dcb000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.239 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-09-16T07:39:37.240+0000 7f9237dcb000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:37.239+0000 7fc6700fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.308 INFO:teuthology.orchestra.run.smithi137.stderr:adjusted tunables profile to default 2024-09-16T07:39:37.320 INFO:tasks.ceph:check_enable_crimson: True 2024-09-16T07:39:37.320 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-16T07:39:37.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-16T07:39:37.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:37.421+0000 7f7941191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:37.430+0000 7f7941191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:37.507 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-09-16T07:39:37.508+0000 7f6baedf4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-16T07:39:37.508 INFO:tasks.ceph.mon.a.smithi137.stderr:Please be aware that this feature is experimental, untested, 2024-09-16T07:39:37.508 INFO:tasks.ceph.mon.a.smithi137.stderr:unsupported, and may result in data corruption, data loss, 2024-09-16T07:39:37.508 INFO:tasks.ceph.mon.a.smithi137.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-16T07:39:37.508 INFO:tasks.ceph.mon.a.smithi137.stderr:feature with important data. 2024-09-16T07:39:37.508 INFO:tasks.ceph.mon.a.smithi137.stderr: 2024-09-16T07:39:38.323 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T07:39:38.324 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:38.324 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T07:39:38.351 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-09-16T07:39:38.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T07:39:38.418 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:38.418 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T07:39:38.443 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-16T07:39:38.444 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T07:39:38.508 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 04953245-7929-4d22-9c69-528c0bf85165 0 2024-09-16T07:39:38.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-16T07:39:38.650+0000 7ff50c911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:38.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-16T07:39:38.659+0000 7ff50c911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:38.747 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-09-16T07:39:38.759 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 3d6ab8ec-fe47-4181-91c6-bc884de20fe4 1 2024-09-16T07:39:38.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-16T07:39:38.860+0000 7f39ded91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:38.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-16T07:39:38.869+0000 7f39ded91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:38.943 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-09-16T07:39:38.956 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 1826ced5-0469-410d-8e8b-172b170fb655 2 2024-09-16T07:39:39.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-16T07:39:39.057+0000 7f062726c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:39.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-16T07:39:39.066+0000 7f062726c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-09-16T07:39:39.154 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new f8f5be82-c330-44a2-b341-caba448da614 3 2024-09-16T07:39:39.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-16T07:39:39.255+0000 7f6e25497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:39.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-16T07:39:39.265+0000 7f6e25497640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:39.340 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-09-16T07:39:39.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-16T07:39:39.387 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T07:39:39.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-16T07:39:39.430 INFO:tasks.ceph.osd.0:Started 2024-09-16T07:39:39.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-16T07:39:39.462 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T07:39:39.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-16T07:39:39.505 INFO:tasks.ceph.osd.1:Started 2024-09-16T07:39:39.505 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-16T07:39:39.535 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T07:39:39.535 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-16T07:39:39.577 INFO:tasks.ceph.osd.2:Started 2024-09-16T07:39:39.578 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-16T07:39:39.606 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T07:39:39.607 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-16T07:39:39.649 INFO:tasks.ceph.osd.3:Started 2024-09-16T07:39:39.649 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:39:39.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:39.759+0000 7f9b0dd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:39.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:39.768+0000 7f9b0dd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:39.839 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:39.839 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"fsid":"ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803","created":"2024-09-16T07:39:37.227795+0000","modified":"2024-09-16T07:39:39.340153+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:39:39.340153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"04953245-7929-4d22-9c69-528c0bf85165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3d6ab8ec-fe47-4181-91c6-bc884de20fe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1826ced5-0469-410d-8e8b-172b170fb655","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f8f5be82-c330-44a2-b341-caba448da614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:39:39.851 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T07:39:39.851 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T07:39:40.254 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:39:40.359 INFO:teuthology.misc.health.smithi137.stderr:2024-09-16T07:39:40.355+0000 7efc57191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:40.363 INFO:teuthology.misc.health.smithi137.stderr:2024-09-16T07:39:40.364+0000 7efc57191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:40.433 INFO:teuthology.misc.health.smithi137.stdout: 2024-09-16T07:39:40.433 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":7,"fsid":"ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803","created":"2024-09-16T07:39:37.227795+0000","modified":"2024-09-16T07:39:39.340153+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T07:39:39.340153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"04953245-7929-4d22-9c69-528c0bf85165","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3d6ab8ec-fe47-4181-91c6-bc884de20fe4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1826ced5-0469-410d-8e8b-172b170fb655","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f8f5be82-c330-44a2-b341-caba448da614","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:39:40.443 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-16T07:39:42.699 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-09-16T07:39:42.700+0000 7f91d5104640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-16T07:39:46.847 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T07:39:46.949 INFO:teuthology.misc.health.smithi137.stderr:2024-09-16T07:39:46.945+0000 7f0e1c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:46.952 INFO:teuthology.misc.health.smithi137.stderr:2024-09-16T07:39:46.953+0000 7f0e1c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:47.140 INFO:teuthology.misc.health.smithi137.stdout: 2024-09-16T07:39:47.140 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":10,"fsid":"ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803","created":"2024-09-16T07:39:37.227795+0000","modified":"2024-09-16T07:39:46.710014+0000","last_up_change":"2024-09-16T07:39:44.702046+0000","last_in_change":"2024-09-16T07:39:39.340153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:39:45.716296+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"04953245-7929-4d22-9c69-528c0bf85165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6801","nonce":2719564590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2719564590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2719564590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":2719564590}]},"public_addr":"172.21.15.137:6801/2719564590","cluster_addr":"172.21.15.137:6800/2719564590","heartbeat_back_addr":"172.21.15.137:6802/2719564590","heartbeat_front_addr":"172.21.15.137:6803/2719564590","state":["exists","up"]},{"osd":1,"uuid":"3d6ab8ec-fe47-4181-91c6-bc884de20fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":1191756675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":1191756675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":1191756675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1191756675}]},"public_addr":"172.21.15.137:6807/1191756675","cluster_addr":"172.21.15.137:6808/1191756675","heartbeat_back_addr":"172.21.15.137:6805/1191756675","heartbeat_front_addr":"172.21.15.137:6806/1191756675","state":["exists","up"]},{"osd":2,"uuid":"1826ced5-0469-410d-8e8b-172b170fb655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6803","nonce":3119845536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3119845536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6809","nonce":3119845536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3119845536}]},"public_addr":"172.21.15.170:6803/3119845536","cluster_addr":"172.21.15.170:6804/3119845536","heartbeat_back_addr":"172.21.15.170:6809/3119845536","heartbeat_front_addr":"172.21.15.170:6810/3119845536","state":["exists","up"]},{"osd":3,"uuid":"f8f5be82-c330-44a2-b341-caba448da614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3642008203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6807","nonce":3642008203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6811","nonce":3642008203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3642008203}]},"public_addr":"172.21.15.170:6808/3642008203","cluster_addr":"172.21.15.170:6807/3642008203","heartbeat_back_addr":"172.21.15.170:6811/3642008203","heartbeat_front_addr":"172.21.15.170:6812/3642008203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:39:47.152 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-16T07:39:47.152 INFO:tasks.ceph:Creating RBD pool 2024-09-16T07:39:47.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T07:39:47.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:47.253+0000 7f549e446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:47.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:47.265+0000 7f549e446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:47.713 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'rbd' created 2024-09-16T07:39:47.731 DEBUG:teuthology.orchestra.run.smithi137:> rbd --cluster ceph pool init rbd 2024-09-16T07:39:47.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:47.892+0000 7fa4b780dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:47.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:47.892+0000 7fa4b780dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:47.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:47.899+0000 7fa4b780dac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:50.776 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T07:39:50.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-16T07:39:50.778 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T07:39:50.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:50.883+0000 7f232fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:50.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:50.892+0000 7f232fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:51.080 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:51.093 INFO:teuthology.orchestra.run.smithi137.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-16T07:39:51.093 INFO:tasks.ceph_manager:config epoch is 1 2024-09-16T07:39:51.093 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T07:39:51.093 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T07:39:51.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T07:39:51.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:51.199+0000 7fa17e66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:51.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:51.207+0000 7fa17e66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:51.441 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:51.452 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":1054989962},{"type":"v1","addr":"172.21.15.170:6801","nonce":1054989962}]},"active_addr":"172.21.15.170:6801/1054989962","active_change":"2024-09-16T07:39:41.690616+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2471310338}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":485126401}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1269842531}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2497461179}]}]} 2024-09-16T07:39:51.456 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T07:39:51.456 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T07:39:51.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:39:51.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:51.562+0000 7fa9406d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:51.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:51.569+0000 7fa9406d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:51.755 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:51.755 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"fsid":"ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803","created":"2024-09-16T07:39:37.227795+0000","modified":"2024-09-16T07:39:50.735379+0000","last_up_change":"2024-09-16T07:39:44.702046+0000","last_in_change":"2024-09-16T07:39:39.340153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:39:45.716296+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:39:47.454199+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"04953245-7929-4d22-9c69-528c0bf85165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6801","nonce":2719564590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2719564590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2719564590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":2719564590}]},"public_addr":"172.21.15.137:6801/2719564590","cluster_addr":"172.21.15.137:6800/2719564590","heartbeat_back_addr":"172.21.15.137:6802/2719564590","heartbeat_front_addr":"172.21.15.137:6803/2719564590","state":["exists","up"]},{"osd":1,"uuid":"3d6ab8ec-fe47-4181-91c6-bc884de20fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":1191756675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":1191756675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":1191756675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1191756675}]},"public_addr":"172.21.15.137:6807/1191756675","cluster_addr":"172.21.15.137:6808/1191756675","heartbeat_back_addr":"172.21.15.137:6805/1191756675","heartbeat_front_addr":"172.21.15.137:6806/1191756675","state":["exists","up"]},{"osd":2,"uuid":"1826ced5-0469-410d-8e8b-172b170fb655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6803","nonce":3119845536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3119845536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6809","nonce":3119845536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3119845536}]},"public_addr":"172.21.15.170:6803/3119845536","cluster_addr":"172.21.15.170:6804/3119845536","heartbeat_back_addr":"172.21.15.170:6809/3119845536","heartbeat_front_addr":"172.21.15.170:6810/3119845536","state":["exists","up"]},{"osd":3,"uuid":"f8f5be82-c330-44a2-b341-caba448da614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3642008203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6807","nonce":3642008203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6811","nonce":3642008203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3642008203}]},"public_addr":"172.21.15.170:6808/3642008203","cluster_addr":"172.21.15.170:6807/3642008203","heartbeat_back_addr":"172.21.15.170:6811/3642008203","heartbeat_front_addr":"172.21.15.170:6812/3642008203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:39:51.769 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T07:39:51.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:39:51.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:51.873+0000 7f9b06391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:51.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:51.880+0000 7f9b06391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.066 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:52.066 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"fsid":"ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803","created":"2024-09-16T07:39:37.227795+0000","modified":"2024-09-16T07:39:50.735379+0000","last_up_change":"2024-09-16T07:39:44.702046+0000","last_in_change":"2024-09-16T07:39:39.340153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:39:45.716296+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:39:47.454199+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"04953245-7929-4d22-9c69-528c0bf85165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6801","nonce":2719564590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2719564590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2719564590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":2719564590}]},"public_addr":"172.21.15.137:6801/2719564590","cluster_addr":"172.21.15.137:6800/2719564590","heartbeat_back_addr":"172.21.15.137:6802/2719564590","heartbeat_front_addr":"172.21.15.137:6803/2719564590","state":["exists","up"]},{"osd":1,"uuid":"3d6ab8ec-fe47-4181-91c6-bc884de20fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":1191756675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":1191756675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":1191756675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1191756675}]},"public_addr":"172.21.15.137:6807/1191756675","cluster_addr":"172.21.15.137:6808/1191756675","heartbeat_back_addr":"172.21.15.137:6805/1191756675","heartbeat_front_addr":"172.21.15.137:6806/1191756675","state":["exists","up"]},{"osd":2,"uuid":"1826ced5-0469-410d-8e8b-172b170fb655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6803","nonce":3119845536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3119845536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6809","nonce":3119845536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3119845536}]},"public_addr":"172.21.15.170:6803/3119845536","cluster_addr":"172.21.15.170:6804/3119845536","heartbeat_back_addr":"172.21.15.170:6809/3119845536","heartbeat_front_addr":"172.21.15.170:6810/3119845536","state":["exists","up"]},{"osd":3,"uuid":"f8f5be82-c330-44a2-b341-caba448da614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3642008203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6807","nonce":3642008203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6811","nonce":3642008203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3642008203}]},"public_addr":"172.21.15.170:6808/3642008203","cluster_addr":"172.21.15.170:6807/3642008203","heartbeat_back_addr":"172.21.15.170:6811/3642008203","heartbeat_front_addr":"172.21.15.170:6812/3642008203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:39:52.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T07:39:52.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T07:39:52.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T07:39:52.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T07:39:52.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.197+0000 7efd95991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.198+0000 7fe068791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.197+0000 7fd234351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.207+0000 7efd95991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.207+0000 7fe068791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.197+0000 7f3c6ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.213+0000 7f3c6ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.213+0000 7fd234351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.239 INFO:teuthology.orchestra.run.smithi137.stdout:38654705671 2024-09-16T07:39:52.239 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:39:52.247 INFO:teuthology.orchestra.run.smithi137.stdout:38654705671 2024-09-16T07:39:52.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:39:52.253 INFO:teuthology.orchestra.run.smithi137.stdout:38654705671 2024-09-16T07:39:52.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:39:52.254 INFO:teuthology.orchestra.run.smithi137.stdout:38654705671 2024-09-16T07:39:52.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T07:39:52.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.351+0000 7fd5af191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.361+0000 7fd5af191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.364+0000 7fc2a488e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.377+0000 7fc2a488e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.411+0000 7f9a874d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.414+0000 7f6623d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.420+0000 7f9a874d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.425+0000 7f6623d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.583 INFO:teuthology.orchestra.run.smithi137.stdout:38654705671 2024-09-16T07:39:52.596 INFO:teuthology.orchestra.run.smithi137.stdout:38654705671 2024-09-16T07:39:52.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-16T07:39:52.597 DEBUG:teuthology.parallel:result is None 2024-09-16T07:39:52.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-09-16T07:39:52.609 DEBUG:teuthology.parallel:result is None 2024-09-16T07:39:52.616 INFO:teuthology.orchestra.run.smithi137.stdout:38654705671 2024-09-16T07:39:52.630 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2024-09-16T07:39:52.630 DEBUG:teuthology.parallel:result is None 2024-09-16T07:39:52.650 INFO:teuthology.orchestra.run.smithi137.stdout:38654705671 2024-09-16T07:39:52.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-16T07:39:52.664 DEBUG:teuthology.parallel:result is None 2024-09-16T07:39:52.664 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:39:52.664 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:39:52.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.809+0000 7f8bac308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:52.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:52.817+0000 7f8bac308640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:53.000 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:53.000 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:39:53.013 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-16T07:39:52.238445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":671744,"data_stored":1896065,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.748319+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:50.748319+0000","last_peered":"2024-09-16T07:39:50.748319+0000","last_clean":"2024-09-16T07:39:50.748319+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:50.748319+0000","last_undegraded":"2024-09-16T07:39:50.748319+0000","last_fullsized":"2024-09-16T07:39:50.748319+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749030+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:50.749030+0000","last_peered":"2024-09-16T07:39:50.749030+0000","last_clean":"2024-09-16T07:39:50.749030+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:50.749030+0000","last_undegraded":"2024-09-16T07:39:50.749030+0000","last_fullsized":"2024-09-16T07:39:50.749030+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755771+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:50.755771+0000","last_peered":"2024-09-16T07:39:50.755771+0000","last_clean":"2024-09-16T07:39:50.755771+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:50.755771+0000","last_undegraded":"2024-09-16T07:39:50.755771+0000","last_fullsized":"2024-09-16T07:39:50.755771+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755068+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:50.755068+0000","last_peered":"2024-09-16T07:39:50.755068+0000","last_clean":"2024-09-16T07:39:50.755068+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:50.755068+0000","last_undegraded":"2024-09-16T07:39:50.755068+0000","last_fullsized":"2024-09-16T07:39:50.755068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.757219+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:50.757219+0000","last_peered":"2024-09-16T07:39:50.757219+0000","last_clean":"2024-09-16T07:39:50.757219+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:50.757219+0000","last_undegraded":"2024-09-16T07:39:50.757219+0000","last_fullsized":"2024-09-16T07:39:50.757219+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.750733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:50.750733+0000","last_peered":"2024-09-16T07:39:50.750733+0000","last_clean":"2024-09-16T07:39:50.750733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:50.750733+0000","last_undegraded":"2024-09-16T07:39:50.750733+0000","last_fullsized":"2024-09-16T07:39:50.750733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749786+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:50.749786+0000","last_peered":"2024-09-16T07:39:50.749786+0000","last_clean":"2024-09-16T07:39:50.749786+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:50.749786+0000","last_undegraded":"2024-09-16T07:39:50.749786+0000","last_fullsized":"2024-09-16T07:39:50.749786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.754893+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:50.754893+0000","last_peered":"2024-09-16T07:39:50.754893+0000","last_clean":"2024-09-16T07:39:50.754893+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:50.754893+0000","last_undegraded":"2024-09-16T07:39:50.754893+0000","last_fullsized":"2024-09-16T07:39:50.754893+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":85,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.751147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:50.751147+0000","last_peered":"2024-09-16T07:39:50.751147+0000","last_clean":"2024-09-16T07:39:50.751147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:50.751147+0000","last_undegraded":"2024-09-16T07:39:50.751147+0000","last_fullsized":"2024-09-16T07:39:50.751147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":31245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":180224,"data_stored":621594,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:39:53.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:39:53.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:53.119+0000 7f66bcca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:53.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:53.127+0000 7f66bcca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:53.312 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:53.312 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:39:53.324 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-16T07:39:52.238445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":671744,"data_stored":1896065,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.748319+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:50.748319+0000","last_peered":"2024-09-16T07:39:50.748319+0000","last_clean":"2024-09-16T07:39:50.748319+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:50.748319+0000","last_undegraded":"2024-09-16T07:39:50.748319+0000","last_fullsized":"2024-09-16T07:39:50.748319+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749030+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:50.749030+0000","last_peered":"2024-09-16T07:39:50.749030+0000","last_clean":"2024-09-16T07:39:50.749030+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:50.749030+0000","last_undegraded":"2024-09-16T07:39:50.749030+0000","last_fullsized":"2024-09-16T07:39:50.749030+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755771+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:50.755771+0000","last_peered":"2024-09-16T07:39:50.755771+0000","last_clean":"2024-09-16T07:39:50.755771+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:50.755771+0000","last_undegraded":"2024-09-16T07:39:50.755771+0000","last_fullsized":"2024-09-16T07:39:50.755771+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755068+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:50.755068+0000","last_peered":"2024-09-16T07:39:50.755068+0000","last_clean":"2024-09-16T07:39:50.755068+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:50.755068+0000","last_undegraded":"2024-09-16T07:39:50.755068+0000","last_fullsized":"2024-09-16T07:39:50.755068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.757219+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:50.757219+0000","last_peered":"2024-09-16T07:39:50.757219+0000","last_clean":"2024-09-16T07:39:50.757219+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:50.757219+0000","last_undegraded":"2024-09-16T07:39:50.757219+0000","last_fullsized":"2024-09-16T07:39:50.757219+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.750733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:50.750733+0000","last_peered":"2024-09-16T07:39:50.750733+0000","last_clean":"2024-09-16T07:39:50.750733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:50.750733+0000","last_undegraded":"2024-09-16T07:39:50.750733+0000","last_fullsized":"2024-09-16T07:39:50.750733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749786+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:50.749786+0000","last_peered":"2024-09-16T07:39:50.749786+0000","last_clean":"2024-09-16T07:39:50.749786+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:50.749786+0000","last_undegraded":"2024-09-16T07:39:50.749786+0000","last_fullsized":"2024-09-16T07:39:50.749786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.754893+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:50.754893+0000","last_peered":"2024-09-16T07:39:50.754893+0000","last_clean":"2024-09-16T07:39:50.754893+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:50.754893+0000","last_undegraded":"2024-09-16T07:39:50.754893+0000","last_fullsized":"2024-09-16T07:39:50.754893+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":85,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.751147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:50.751147+0000","last_peered":"2024-09-16T07:39:50.751147+0000","last_clean":"2024-09-16T07:39:50.751147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:50.751147+0000","last_undegraded":"2024-09-16T07:39:50.751147+0000","last_fullsized":"2024-09-16T07:39:50.751147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":31245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":180224,"data_stored":621594,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:39:53.325 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:39:53.325 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T07:39:53.325 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T07:39:53.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T07:39:53.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:53.430+0000 7fef3a348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:53.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:53.436+0000 7fef3a348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:53.657 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:53.658 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T07:39:53.671 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T07:39:53.671 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-16T07:39:53.682 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T07:39:53.683 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}} 2024-09-16T07:39:53.683 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-16T07:39:53.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-16T07:39:53.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:53.789+0000 7fd605c3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:53.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:53.800+0000 7fd605c3e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:54.002 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-16T07:39:54.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:39:54.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:39:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:54.107+0000 7f0fc2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:54.114+0000 7f0fc2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:54.299 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:39:54.312 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T07:39:53.698110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":671744,"data_stored":1896065,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.459665"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.748319+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:50.748319+0000","last_peered":"2024-09-16T07:39:50.748319+0000","last_clean":"2024-09-16T07:39:50.748319+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:50.748319+0000","last_undegraded":"2024-09-16T07:39:50.748319+0000","last_fullsized":"2024-09-16T07:39:50.748319+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749030+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:50.749030+0000","last_peered":"2024-09-16T07:39:50.749030+0000","last_clean":"2024-09-16T07:39:50.749030+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:50.749030+0000","last_undegraded":"2024-09-16T07:39:50.749030+0000","last_fullsized":"2024-09-16T07:39:50.749030+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755771+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:50.755771+0000","last_peered":"2024-09-16T07:39:50.755771+0000","last_clean":"2024-09-16T07:39:50.755771+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:50.755771+0000","last_undegraded":"2024-09-16T07:39:50.755771+0000","last_fullsized":"2024-09-16T07:39:50.755771+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755068+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:50.755068+0000","last_peered":"2024-09-16T07:39:50.755068+0000","last_clean":"2024-09-16T07:39:50.755068+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:50.755068+0000","last_undegraded":"2024-09-16T07:39:50.755068+0000","last_fullsized":"2024-09-16T07:39:50.755068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.757219+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:50.757219+0000","last_peered":"2024-09-16T07:39:50.757219+0000","last_clean":"2024-09-16T07:39:50.757219+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:50.757219+0000","last_undegraded":"2024-09-16T07:39:50.757219+0000","last_fullsized":"2024-09-16T07:39:50.757219+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.750733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:50.750733+0000","last_peered":"2024-09-16T07:39:50.750733+0000","last_clean":"2024-09-16T07:39:50.750733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:50.750733+0000","last_undegraded":"2024-09-16T07:39:50.750733+0000","last_fullsized":"2024-09-16T07:39:50.750733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749786+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:50.749786+0000","last_peered":"2024-09-16T07:39:50.749786+0000","last_clean":"2024-09-16T07:39:50.749786+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:50.749786+0000","last_undegraded":"2024-09-16T07:39:50.749786+0000","last_fullsized":"2024-09-16T07:39:50.749786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.754893+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:50.754893+0000","last_peered":"2024-09-16T07:39:50.754893+0000","last_clean":"2024-09-16T07:39:50.754893+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:50.754893+0000","last_undegraded":"2024-09-16T07:39:50.754893+0000","last_fullsized":"2024-09-16T07:39:50.754893+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":85,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.751147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:50.751147+0000","last_peered":"2024-09-16T07:39:50.751147+0000","last_clean":"2024-09-16T07:39:50.751147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:50.751147+0000","last_undegraded":"2024-09-16T07:39:50.751147+0000","last_fullsized":"2024-09-16T07:39:50.751147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":31245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":180224,"data_stored":621594,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:39:54.314 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:39:54.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:54.418+0000 7f8fcec5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:54.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:54.426+0000 7f8fcec5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:54.609 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:54.610 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:39:54.622 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-16T07:39:53.698110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":671744,"data_stored":1896065,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.459665"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.748319+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:50.748319+0000","last_peered":"2024-09-16T07:39:50.748319+0000","last_clean":"2024-09-16T07:39:50.748319+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:50.748319+0000","last_undegraded":"2024-09-16T07:39:50.748319+0000","last_fullsized":"2024-09-16T07:39:50.748319+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749030+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:50.749030+0000","last_peered":"2024-09-16T07:39:50.749030+0000","last_clean":"2024-09-16T07:39:50.749030+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:50.749030+0000","last_undegraded":"2024-09-16T07:39:50.749030+0000","last_fullsized":"2024-09-16T07:39:50.749030+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755771+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:50.755771+0000","last_peered":"2024-09-16T07:39:50.755771+0000","last_clean":"2024-09-16T07:39:50.755771+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:50.755771+0000","last_undegraded":"2024-09-16T07:39:50.755771+0000","last_fullsized":"2024-09-16T07:39:50.755771+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755068+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:50.755068+0000","last_peered":"2024-09-16T07:39:50.755068+0000","last_clean":"2024-09-16T07:39:50.755068+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:50.755068+0000","last_undegraded":"2024-09-16T07:39:50.755068+0000","last_fullsized":"2024-09-16T07:39:50.755068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.757219+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:50.757219+0000","last_peered":"2024-09-16T07:39:50.757219+0000","last_clean":"2024-09-16T07:39:50.757219+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:50.757219+0000","last_undegraded":"2024-09-16T07:39:50.757219+0000","last_fullsized":"2024-09-16T07:39:50.757219+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.750733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:50.750733+0000","last_peered":"2024-09-16T07:39:50.750733+0000","last_clean":"2024-09-16T07:39:50.750733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:50.750733+0000","last_undegraded":"2024-09-16T07:39:50.750733+0000","last_fullsized":"2024-09-16T07:39:50.750733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749786+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:50.749786+0000","last_peered":"2024-09-16T07:39:50.749786+0000","last_clean":"2024-09-16T07:39:50.749786+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:50.749786+0000","last_undegraded":"2024-09-16T07:39:50.749786+0000","last_fullsized":"2024-09-16T07:39:50.749786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.754893+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:50.754893+0000","last_peered":"2024-09-16T07:39:50.754893+0000","last_clean":"2024-09-16T07:39:50.754893+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:50.754893+0000","last_undegraded":"2024-09-16T07:39:50.754893+0000","last_fullsized":"2024-09-16T07:39:50.754893+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":85,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.751147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:50.751147+0000","last_peered":"2024-09-16T07:39:50.751147+0000","last_clean":"2024-09-16T07:39:50.751147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:50.751147+0000","last_undegraded":"2024-09-16T07:39:50.751147+0000","last_fullsized":"2024-09-16T07:39:50.751147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":31245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":180224,"data_stored":621594,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:39:54.623 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:39:54.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-16T07:39:54.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:54.730+0000 7fc145efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:54.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:54.738+0000 7fc145efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:54.924 INFO:teuthology.orchestra.run.smithi137.stdout:epoch 14 2024-09-16T07:39:54.924 INFO:teuthology.orchestra.run.smithi137.stdout:fsid ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803 2024-09-16T07:39:54.924 INFO:teuthology.orchestra.run.smithi137.stdout:created 2024-09-16T07:39:37.227795+0000 2024-09-16T07:39:54.924 INFO:teuthology.orchestra.run.smithi137.stdout:modified 2024-09-16T07:39:50.735379+0000 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:crush_version 3 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:full_ratio 0.95 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:backfillfull_ratio 0.9 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:nearfull_ratio 0.85 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:require_min_compat_client luminous 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:min_compat_client jewel 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:require_osd_release squid 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:stretch_mode_enabled false 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:allow_crimson=true 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.00 2024-09-16T07:39:54.925 INFO:teuthology.orchestra.run.smithi137.stdout: removed_snaps_queue [2~1] 2024-09-16T07:39:54.926 INFO:teuthology.orchestra.run.smithi137.stdout:max_osd 4 2024-09-16T07:39:54.926 INFO:teuthology.orchestra.run.smithi137.stdout:osd.0 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.137:6801/2719564590 v2:172.21.15.137:6800/2719564590 exists,up 04953245-7929-4d22-9c69-528c0bf85165 2024-09-16T07:39:54.926 INFO:teuthology.orchestra.run.smithi137.stdout:osd.1 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.137:6807/1191756675 v2:172.21.15.137:6808/1191756675 exists,up 3d6ab8ec-fe47-4181-91c6-bc884de20fe4 2024-09-16T07:39:54.926 INFO:teuthology.orchestra.run.smithi137.stdout:osd.2 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.170:6803/3119845536 v2:172.21.15.170:6804/3119845536 exists,up 1826ced5-0469-410d-8e8b-172b170fb655 2024-09-16T07:39:54.926 INFO:teuthology.orchestra.run.smithi137.stdout:osd.3 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.170:6808/3642008203 v2:172.21.15.170:6807/3642008203 exists,up f8f5be82-c330-44a2-b341-caba448da614 2024-09-16T07:39:54.938 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) v2:172.21.15.137:6801/2719564590 v2:172.21.15.137:6800/2719564590 exists,up 04953245-7929-4d22-9c69-528c0bf85165', 'osd.1 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.137:6807/1191756675 v2:172.21.15.137:6808/1191756675 exists,up 3d6ab8ec-fe47-4181-91c6-bc884de20fe4', 'osd.2 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.170:6803/3119845536 v2:172.21.15.170:6804/3119845536 exists,up 1826ced5-0469-410d-8e8b-172b170fb655', 'osd.3 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.170:6808/3642008203 v2:172.21.15.170:6807/3642008203 exists,up f8f5be82-c330-44a2-b341-caba448da614'] 2024-09-16T07:39:54.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-16T07:39:55.045 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-16T07:39:55.045 INFO:teuthology.orchestra.run.smithi137.stdout: "name": "mon.a", 2024-09-16T07:39:55.045 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster": "ceph", 2024-09-16T07:39:55.045 INFO:teuthology.orchestra.run.smithi137.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-16T07:39:55.045 INFO:teuthology.orchestra.run.smithi137.stdout: "admin_socket_mode": "", 2024-09-16T07:39:55.045 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-16T07:39:55.045 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_client_required": "cephx, none", 2024-09-16T07:39:55.045 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_cluster_required": "cephx", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_debug": "true", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_service_required": "cephx", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_supported": "cephx", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_aio": "true", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_aio_poll_ms": "250", 2024-09-16T07:39:55.046 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_aio_reap_max": "16", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_async_discard_threads": "0", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_block_size": "4096", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_debug_aio": "false", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_debug_inflight_ios": "false", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_enable_discard": "false", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_flock_retry": "3", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_inject_crash": "0", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_ioring": "false", 2024-09-16T07:39:55.047 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_ioring_hipri": "false", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bdev_type": "", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_alloc_size": "1048576", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_allocator": "hybrid", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_buffered_io": "true", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_check_for_zeros": "false", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-16T07:39:55.048 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_compact_log_sync": "false", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_max_log_runway": "4194304", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_max_prefetch": "1048576", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_min_flush_size": "524288", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_min_log_runway": "1048576", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_replay_recovery": "false", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-16T07:39:55.049 INFO:teuthology.orchestra.run.smithi137.stdout: "bluefs_sync_write": "false", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_allocation_from_file": "true", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_allocator": "hybrid", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_async_db_compaction": "true", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-16T07:39:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bdev_label_multi": "true", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_create": "true", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_db_create": "false", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_db_path": "", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_db_size": "0", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_path": "", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_preallocate_file": "false", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_size": "107374182400", 2024-09-16T07:39:55.051 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_wal_create": "false", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_wal_path": "", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_block_wal_size": "100663296", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bluefs": "true", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-16T07:39:55.052 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_autotune": "true", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_size": "0", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cache_type": "2q", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_clone_cow": "true", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-16T07:39:55.053 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_mode": "none", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_csum_type": "crc32c", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_freelist": "false", 2024-09-16T07:39:55.054 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-16T07:39:55.055 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_small_allocations": "0", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_default_buffered_read": "true", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_default_buffered_write": "false", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fail_eio": "false", 2024-09-16T07:39:55.056 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_on_mount": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_on_umount": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-16T07:39:55.057 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_ignore_data_csum": "false", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_log_op_age": "5.000000", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_max_alloc_size": "0", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_max_blob_size": "0", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-16T07:39:55.058 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_max_deferred_txc": "32", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_min_alloc_size": "0", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_nid_prealloc": "1024", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_retry_disk_reads": "3", 2024-09-16T07:39:55.059 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_rocksdb_cf": "true", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_spdk_mem": "512", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-16T07:39:55.060 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_tracing": "false", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-16T07:39:55.061 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_write_v2": "false", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_write_v2_random": "false", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "bluestore_zero_block_detection": "false", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-16T07:39:55.062 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephx_cluster_require_signatures": "false", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephx_cluster_require_version": "2", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephx_require_signatures": "false", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephx_require_version": "2", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephx_service_require_signatures": "false", 2024-09-16T07:39:55.063 INFO:teuthology.orchestra.run.smithi137.stdout: "cephx_service_require_version": "2", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "cephx_sign_messages": "true", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "chdir": "", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_acl_type": "", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_asio_thread_count": "2", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_cache_mid": "0.750000", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_cache_size": "16384", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_caps_release_delay": "5", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_check_pool_perm": "true", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_debug_force_sync_read": "false", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_debug_getattr_caps": "false", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_debug_inject_features": "", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_debug_inject_tick_delay": "0", 2024-09-16T07:39:55.064 INFO:teuthology.orchestra.run.smithi137.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_die_on_failed_remount": "false", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_dirsize_rbytes": "true", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_force_lazyio": "false", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_fs": "", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_inject_release_failure": "false", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_max_inline_size": "4096", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_mds_namespace": "", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_metadata": "", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_mount_gid": "-1", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_mount_timeout": "300", 2024-09-16T07:39:55.065 INFO:teuthology.orchestra.run.smithi137.stdout: "client_mount_uid": "-1", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_mountpoint": "/", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_notify_timeout": "10", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_oc": "true", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_oc_max_dirty": "104857600", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_oc_max_objects": "1000", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_oc_size": "209715200", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_oc_target_dirty": "8388608", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_permissions": "true", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_quota": "true", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_quota_df": "true", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_readahead_max_bytes": "0", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_readahead_max_periods": "4", 2024-09-16T07:39:55.066 INFO:teuthology.orchestra.run.smithi137.stdout: "client_readahead_min": "131072", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_reconnect_stale": "false", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_shutdown_timeout": "30", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_snapdir": ".snap", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_tick_interval": "1", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_trace": "", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_try_dentry_invalidate": "false", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_use_faked_inos": "false", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "client_use_random_mds": "false", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "clog_to_graylog": "false", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "clog_to_graylog_port": "12201", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "clog_to_monitors": "default=true", 2024-09-16T07:39:55.067 INFO:teuthology.orchestra.run.smithi137.stdout: "clog_to_syslog": "false", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "clog_to_syslog_level": "info", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_addr": "-", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_network": "", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_network_interface": "", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "compressor_zlib_isal": "false", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "compressor_zlib_level": "5", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "compressor_zlib_winsize": "-15", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "compressor_zstd_level": "1", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-16T07:39:55.068 INFO:teuthology.orchestra.run.smithi137.stdout: "crimson_alien_op_num_threads": "6", 2024-09-16T07:39:55.069 INFO:teuthology.orchestra.run.smithi137.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-16T07:39:55.069 INFO:teuthology.orchestra.run.smithi137.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-16T07:39:55.069 INFO:teuthology.orchestra.run.smithi137.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-16T07:39:55.069 INFO:teuthology.orchestra.run.smithi137.stdout: "crimson_osd_stat_interval": "0", 2024-09-16T07:39:55.069 INFO:teuthology.orchestra.run.smithi137.stdout: "crimson_seastar_cpu_cores": "", 2024-09-16T07:39:55.069 INFO:teuthology.orchestra.run.smithi137.stdout: "crimson_seastar_num_threads": "0", 2024-09-16T07:39:55.069 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_location": "", 2024-09-16T07:39:55.070 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_location_hook": "", 2024-09-16T07:39:55.070 INFO:teuthology.orchestra.run.smithi137.stdout: "crush_location_hook_timeout": "10", 2024-09-16T07:39:55.070 INFO:teuthology.orchestra.run.smithi137.stdout: "daemonize": "false", 2024-09-16T07:39:55.070 INFO:teuthology.orchestra.run.smithi137.stdout: "daos_pool": "tank", 2024-09-16T07:39:55.070 INFO:teuthology.orchestra.run.smithi137.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-16T07:39:55.070 INFO:teuthology.orchestra.run.smithi137.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-16T07:39:55.071 INFO:teuthology.orchestra.run.smithi137.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-16T07:39:55.071 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_alienstore": "0/5", 2024-09-16T07:39:55.071 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_allow_any_pool_priority": "false", 2024-09-16T07:39:55.071 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_asok": "1/5", 2024-09-16T07:39:55.071 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_asok_assert_abort": "false", 2024-09-16T07:39:55.072 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_asserts_on_shutdown": "true", 2024-09-16T07:39:55.072 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_auth": "20/20", 2024-09-16T07:39:55.072 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_bdev": "1/3", 2024-09-16T07:39:55.072 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_bluefs": "1/5", 2024-09-16T07:39:55.072 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_bluestore": "1/5", 2024-09-16T07:39:55.072 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_buffer": "0/1", 2024-09-16T07:39:55.073 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_ceph_dedup": "0/5", 2024-09-16T07:39:55.073 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_ceph_exporter": "1/5", 2024-09-16T07:39:55.073 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_cephfs_mirror": "0/5", 2024-09-16T07:39:55.073 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_cephsqlite": "0/5", 2024-09-16T07:39:55.073 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_client": "0/5", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_compressor": "1/5", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_context": "0/1", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_crimson_interrupt": "0/5", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_crush": "1/1", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_crypto": "1/5", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_cyanstore": "0/5", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_deliberately_leak_memory": "false", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_disable_randomized_ping": "false", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_dpdk": "1/5", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_eventtrace": "1/5", 2024-09-16T07:39:55.074 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_filer": "0/1", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_filestore": "1/3", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_finisher": "1/1", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_fuse": "1/5", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_heartbeat_testing_span": "0", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_heartbeatmap": "1/5", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_javaclient": "1/5", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_journal": "1/3", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_journaler": "0/5", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_kstore": "1/5", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_lockdep": "0/1", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mclock": "1/5", 2024-09-16T07:39:55.075 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mds": "1/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mds_balancer": "1/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mds_locker": "1/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mds_log": "1/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mds_log_expire": "1/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mds_migrator": "1/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mds_quiesce": "3/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_memstore": "1/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mgr": "2/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mgrc": "1/5", 2024-09-16T07:39:55.076 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_mon": "20/20", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_monc": "0/10", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_ms": "1/1", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_none": "0/5", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_objclass": "0/5", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_objectcacher": "0/5", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_objecter": "0/1", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_optracker": "0/5", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_osd": "1/5", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_paxos": "20/20", 2024-09-16T07:39:55.077 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_perfcounter": "1/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_prioritycache": "1/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rados": "0/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rbd": "0/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rbd_mirror": "0/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rbd_pwl": "0/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rbd_replay": "0/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_refs": "0/0", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_reserver": "1/1", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rgw": "1/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rgw_access": "1/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rgw_datacache": "1/5", 2024-09-16T07:39:55.078 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rgw_dbstore": "1/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rgw_flight": "1/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rgw_notification": "1/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rgw_sync": "1/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_rocksdb": "4/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore": "0/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_backref": "0/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_cache": "0/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_cleaner": "0/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_device": "0/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_epm": "0/5", 2024-09-16T07:39:55.079 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_journal": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_lba": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_odata": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_omap": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_onode": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_t": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_seastore_tm": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_striper": "0/1", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_test": "0/5", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_throttle": "1/1", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_timer": "0/1", 2024-09-16T07:39:55.080 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_tp": "0/5", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "debug_trace": "1/5", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "device_failure_prediction_mode": "none", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "err_to_graylog": "false", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "err_to_journald": "false", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "err_to_stderr": "true", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "err_to_syslog": "false", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "event_tracing": "false", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "exporter_addr": "0.0.0.0", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "exporter_cert_file": "", 2024-09-16T07:39:55.081 INFO:teuthology.orchestra.run.smithi137.stdout: "exporter_http_port": "9926", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "exporter_key_file": "", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "exporter_prio_limit": "5", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "exporter_sort_metrics": "true", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "exporter_stats_period": "5", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "fake_statfs_for_testing": "0", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "fatal_signal_handlers": "true", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "filer_max_purge_ops": "10", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "filer_max_truncate_ops": "128", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_apply_finisher_threads": "1", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_blackhole": "false", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_btrfs_clone_range": "true", 2024-09-16T07:39:55.082 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_btrfs_snap": "true", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_caller_concurrency": "10", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_collect_device_partition_information": "true", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_commit_timeout": "600.000000", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_debug_inject_read_err": "false", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_debug_omap_check": "false", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_debug_verify_split": "false", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_dump_file": "", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_fadvise": "true", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_fail_eio": "true", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_fd_cache_shards": "16", 2024-09-16T07:39:55.083 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_fd_cache_size": "128", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_fiemap": "false", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_fiemap_threshold": "4096", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_inject_stall": "0", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_journal_parallel": "false", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_journal_trailing": "false", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_journal_writeahead": "false", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_kill_at": "0", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-16T07:39:55.084 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_inline_xattrs": "0", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_xattr_value_size": "0", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-16T07:39:55.085 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-16T07:39:55.086 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-16T07:39:55.089 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_merge_threshold": "-10", 2024-09-16T07:39:55.089 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-16T07:39:55.089 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_odsync_write": "false", 2024-09-16T07:39:55.089 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_omap_backend": "rocksdb", 2024-09-16T07:39:55.089 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_omap_backend_path": "", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_op_thread_timeout": "60", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_op_threads": "2", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_punch_hole": "false", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-16T07:39:55.090 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_queue_max_ops": "50", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_seek_data_hole": "false", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_sloppy_crc": "false", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_splice": "false", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_split_multiple": "2", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_split_rand_factor": "20", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_update_to": "1000", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-16T07:39:55.091 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_enable": "true", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_xfs_extsize": "false", 2024-09-16T07:39:55.092 INFO:teuthology.orchestra.run.smithi137.stdout: "filestore_zfs_snap": "false", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fio_dir": "/tmp/fio", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fsid": "ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_allow_other": "true", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_atomic_o_trunc": "true", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_big_writes": "true", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_debug": "false", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_default_permissions": "false", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_disable_pagecache": "false", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_max_write": "0", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_multithreaded": "true", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_require_active_mds": "true", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_set_user_groups": "true", 2024-09-16T07:39:55.093 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_splice_move": "true", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_splice_read": "true", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_splice_write": "true", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "fuse_use_invalidate_cb": "true", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "gss_target_name": "ceph", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "heartbeat_file": "", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "heartbeat_inject_failure": "0", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "heartbeat_interval": "5", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "host": "smithi137", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-16T07:39:55.094 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "inject_early_sigterm": "false", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "jaeger_agent_port": "6799", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "jaeger_tracing_enable": "false", 2024-09-16T07:39:55.095 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_aio": "true", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_align_min_size": "65536", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_block_align": "true", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_block_size": "4096", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_dio": "true", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_discard": "false", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_force_aio": "false", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_ignore_corruption": "false", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_max_write_bytes": "10485760", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_max_write_entries": "100", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_replay_from": "0", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-16T07:39:55.096 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_write_header_frequency": "0", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "journal_zero_on_create": "false", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "journaler_prefetch_periods": "10", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "journaler_prezero_periods": "5", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "journaler_write_head_interval": "15", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "keyfile": "", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_backend": "rocksdb", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_default_stripe_size": "65536", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_fsck_on_mount": "false", 2024-09-16T07:39:55.097 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_max_bytes": "67108864", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_max_ops": "512", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_nid_prealloc": "1024", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_onode_map_size": "1024", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_sync_submit_transaction": "false", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "kstore_sync_transaction": "false", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "librados_thread_count": "2", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "lockdep": "false", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "lockdep_force_backtrace": "false", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "log_coarse_timestamps": "true", 2024-09-16T07:39:55.098 INFO:teuthology.orchestra.run.smithi137.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_flush_on_exit": "false", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_graylog_host": "127.0.0.1", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_graylog_port": "12201", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_max_new": "1000", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_max_recent": "10000", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_stderr_prefix": "", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_stop_at_utilization": "0.970000", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_file": "true", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_graylog": "false", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_journald": "false", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_stderr": "false", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "log_to_syslog": "false", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "max_rotating_auth_attempts": "10", 2024-09-16T07:39:55.099 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_action_on_write_error": "1", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_alternate_name_max": "8192", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_asio_thread_count": "2", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_export_pin": "true", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_fragment_dirs": "true", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_fragment_interval": "5", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_interval": "10", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_max": "-1", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_max_until": "-1", 2024-09-16T07:39:55.100 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_merge_size": "50", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_midchunk": "0.300000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_min_start": "0.200000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_minchunk": "0.001000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_mode": "0", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_need_max": "1.200000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_need_min": "0.800000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_overload_epochs": "2", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_split_bits": "3", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-16T07:39:55.101 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_split_size": "10000", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_target_decay": "10.000000", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_beacon_grace": "15.000000", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_beacon_interval": "4.000000", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_mid": "0.700000", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_quiesce_delay": "0", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-16T07:39:55.102 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_release_free_interval": "10", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_reservation": "0.050000", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_trim_interval": "1", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cache_trim_threshold": "262144", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_client_prealloc_inos": "1000", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_connect_bootstrapping": "false", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_damage_table_max_entries": "10000", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_debug_auth_pins": "false", 2024-09-16T07:39:55.103 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_debug_frag": "false", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_debug_scatterstat": "false", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_debug_subtrees": "false", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_decay_halflife": "5.000000", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_default_dir_hash": "2", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_defer_session_stale": "true", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_deny_all_reconnect": "false", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dir_keys_per_op": "16384", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dir_max_commit_size": "10", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dir_max_entries": "0", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dir_prefetch": "true", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-16T07:39:55.104 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dump_cache_on_map": "false", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_early_reply": "true", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_enable_op_tracker": "true", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_enforce_unique_name": "true", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_export_ephemeral_random": "true", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-16T07:39:55.105 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_health_summarize_threshold": "10", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_inject_health_dummy": "false", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_inject_migrator_session_race": "false", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-16T07:39:55.106 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_join_fs": "", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_journal_format": "1", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_create_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_dirfrag_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_export_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_import_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_journal_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_journal_expire_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_journal_replay_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_link_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_mdstable_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_openc_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_rename_at": "0", 2024-09-16T07:39:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_kill_shutdown_at": "0", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_event_large_threshold": "524288", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_events_per_segment": "1024", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_max_events": "-1", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_max_segments": "128", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_pause": "false", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_segment_size": "0", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_trim_threshold": "128", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-16T07:39:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_log_warn_factor": "2.000000", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_caps_per_client": "1048576", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_completed_flushes": "100000", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_completed_requests": "100000", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_export_size": "20971520", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_file_recover": "32", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_purge_files": "64", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_purge_ops": "8192", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_max_snaps_per_dir": "100", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_metrics_update_interval": "2", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_min_caps_per_client": "100", 2024-09-16T07:39:55.109 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_min_caps_working_set": "10000", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_numa_node": "-1", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_op_complaint_time": "30.000000", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_op_history_duration": "600", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_op_history_size": "20", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_op_history_slow_op_size": "20", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_op_log_threshold": "5", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_ping_grace": "15", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_ping_interval": "5", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-16T07:39:55.110 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_recall_max_caps": "30000", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_recall_warning_threshold": "262144", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_replay_interval": "1.000000", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_root_ino_gid": "0", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_root_ino_uid": "0", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_scrub_stats_review_period": "1", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-16T07:39:55.111 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_shutdown_check": "0", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_skip_ino": "0", 2024-09-16T07:39:55.112 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_snap_max_uid": "4294967294", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_snap_min_uid": "0", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_snap_rstat": "false", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_standby_replay_damaged": "false", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_symlink_recovery": "true", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_thrash_exports": "0", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_thrash_fragments": "0", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_tick_interval": "5.000000", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_valgrind_exit": "false", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_verify_backtrace": "1", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_verify_scatter": "false", 2024-09-16T07:39:55.113 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_wipe_sessions": "false", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mempool_debug": "false", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "memstore_device_bytes": "1073741824", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "memstore_page_set": "false", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "memstore_page_size": "65536", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_client_bytes": "134217728", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_client_messages": "512", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_disabled_modules": "", 2024-09-16T07:39:55.114 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_enable_op_tracker": "true", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_max_pg_creating": "1024", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_max_pg_num_change": "128", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_mds_bytes": "134217728", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_mds_messages": "128", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_mon_bytes": "134217728", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_mon_messages": "128", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_op_history_duration": "600", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_op_history_size": "20", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-16T07:39:55.115 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_op_log_threshold": "5", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_osd_bytes": "536870912", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_osd_messages": "8192", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_pool": "true", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_standby_modules": "true", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_stats_period": "5", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_stats_threshold": "5", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_tick_period": "2", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_allow_pool_delete": "true", 2024-09-16T07:39:55.116 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_allow_pool_size_one": "true", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_auth_validate_all_caps": "true", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_bytes": "104857600", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_directed_command_retry": "2", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_hunt_parallel": "3", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_log_interval": "1.000000", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-16T07:39:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_ping_interval": "10.000000", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_client_target_rank": "-1", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_level": "debug", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_to_file": "true", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_to_journald": "false", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-16T07:39:55.118 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_compact_on_bootstrap": "false", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_compact_on_start": "false", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_compact_on_trim": "true", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_cpu_threads": "4", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_crush_min_required_version": "hammer", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_daemon_bytes": "419430400", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_data_avail_crit": "5", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_data_avail_warn": "5", 2024-09-16T07:39:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_data_size_warn": "16106127360", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_dump_json": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_dump_transactions": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_extra_checks": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_no_require_reef": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_no_require_squid": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-16T07:39:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_down_mkfs_grace": "120", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_down_uptime_grace": "60", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_election_default_strategy": "1", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_election_timeout": "5.000000", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_elector_ping_divisor": "2", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_enable_op_tracker": "true", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_fake_pool_delete": "false", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_force_quorum_join": "false", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_globalid_prealloc": "10000", 2024-09-16T07:39:55.121 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_health_detail_to_clog": "false", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_health_log_update_period": "5", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_health_max_detail": "50", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_health_to_clog": "true", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_health_to_clog_interval": "600", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_host": "172.21.15.137", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_host_override": "", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_initial_members": "", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-16T07:39:55.122 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_lease": "5.000000", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_log_full_interval": "50", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_log_max": "10000", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_log_max_summary": "50", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_log_epochs": "500", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_osd": "10000", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_pg_per_osd": "10000", 2024-09-16T07:39:55.123 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_pool_pg_num": "65536", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mds_force_trim_to": "0", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mds_skip_sanity": "false", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_memory_autotune": "true", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_memory_target": "2147483648", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mgr_beacon_grace": "30", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mgr_digest_period": "5", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mgr_inactive_grace": "60", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_min_osdmap_epochs": "50", 2024-09-16T07:39:55.124 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_op_complaint_time": "30", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_op_history_duration": "600", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_op_history_size": "20", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_op_history_slow_op_size": "20", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_op_log_threshold": "5", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_auto_mark_in": "false", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-16T07:39:55.125 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_cache_size": "500", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_down_out_interval": "600", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_force_trim_to": "0", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-16T07:39:55.126 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_min_down_reporters": "2", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_report_timeout": "900", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-16T07:39:55.127 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_pg_stuck_threshold": "60", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-16T07:39:55.128 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_probe_timeout": "2.000000", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_reweight_max_change": "0.050000", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_reweight_max_osds": "4", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-16T07:39:55.129 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_scrub_interval": "86400", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_scrub_max_keys": "100", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_scrub_timeout": "300", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_session_timeout": "300", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_smart_report_timeout": "5", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_stat_smooth_intervals": "6", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_stretch_pool_min_size": "2", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_stretch_pool_size": "4", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-16T07:39:55.130 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_sync_debug": "false", 2024-09-16T07:39:55.131 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-16T07:39:55.131 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-16T07:39:55.131 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_sync_provider_kill_at": "0", 2024-09-16T07:39:55.131 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_sync_requester_kill_at": "0", 2024-09-16T07:39:55.131 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_sync_timeout": "60.000000", 2024-09-16T07:39:55.131 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_target_pg_per_osd": "100", 2024-09-16T07:39:55.131 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_tick_interval": "5", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_timecheck_interval": "300.000000", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_use_min_delay_socket": "false", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_older_version_delay": "604800", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-16T07:39:55.132 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_misplaced": "false", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_older_version": "true", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-16T07:39:55.133 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "monmap": "", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "motr_tracing_enabled": "false", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_op_threads": "3", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_cm": "false", 2024-09-16T07:39:55.134 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_device_name": "", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_dscp": "96", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_local_gid": "", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_port_num": "1", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_sl": "3", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_support_srq": "true", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_rdma_type": "ib", 2024-09-16T07:39:55.135 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_async_reap_threshold": "5", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_before_connect": "false", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_ipv4": "true", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_ipv6": "false", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_msgr1": "true", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_msgr2": "true", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_port_max": "7568", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_port_min": "6800", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_retry_count": "3", 2024-09-16T07:39:55.136 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_bind_retry_delay": "5", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_blackhole_client": "false", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_blackhole_mds": "false", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_blackhole_mgr": "false", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_blackhole_mon": "false", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_blackhole_osd": "false", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_client_mode": "crc", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_cluster_mode": "crc", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_cluster_type": "", 2024-09-16T07:39:55.137 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_compress_secure": "false", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_connection_idle_timeout": "900", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_connection_ready_timeout": "10", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_crc_data": "true", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_crc_header": "true", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_die_on_bad_msg": "false", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_die_on_bug": "true", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_die_on_old_message": "true", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_die_on_skipped_message": "false", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-16T07:39:55.138 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_coremask": "0xF", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_enable_tso": "true", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_hugepages": "", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_lro": "true", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_memory_channel": "4", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_pmd": "", 2024-09-16T07:39:55.139 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_port_id": "0", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_dump_on_send": "false", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_initial_backoff": "0.200000", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_inject_delay_max": "1.000000", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_inject_delay_type": "", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_inject_network_congestion": "0", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_inject_socket_failures": "0", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_learn_addr_from_peer": "true", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_max_accept_failures": "4", 2024-09-16T07:39:55.140 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_max_backoff": "15.000000", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_mon_client_mode": "crc", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_mon_cluster_mode": "crc", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_mon_service_mode": "crc", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_osd_compress_min_size": "1024", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_osd_compress_mode": "none", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_pq_min_cost": "65536", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_public_type": "", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_service_mode": "crc", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_tcp_listen_backlog": "512", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_tcp_nodelay": "true", 2024-09-16T07:39:55.141 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_tcp_rcvbuf": "0", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "ms_type": "async+posix", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "no_config_file": "false", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter_completion_locks_per_session": "32", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-16T07:39:55.142 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter_inflight_ops": "1024", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter_tick_interval": "5.000000", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "objecter_timeout": "10.000000", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "objectstore_blackhole": "false", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "openssl_engine_opts": "", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_agent_delay_time": "5.000000", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_agent_hist_halflife": "1000", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_agent_max_low_ops": "2", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_agent_max_ops": "4", 2024-09-16T07:39:55.143 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_agent_slop": "0.020000", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_asio_thread_count": "2", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_async_recovery_min_cost": "100", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_backfill_scan_max": "512", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_backfill_scan_min": "64", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_backoff_on_degraded": "false", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_backoff_on_peering": "false", 2024-09-16T07:39:55.144 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_backoff_on_unfound": "true", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_beacon_report_interval": "300", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bench_duration": "30", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bench_max_block_size": "67108864", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_blkin_trace_all": "false", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_check_for_log_corruption": "false", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-16T07:39:55.145 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_class_update_on_start": "true", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_client_message_cap": "256", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_client_message_size_cap": "524288000", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_client_op_priority": "63", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_client_watch_timeout": "30", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_command_max_records": "256", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_compact_on_start": "false", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_crush_update_on_start": "true", 2024-09-16T07:39:55.146 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_crush_update_weight_set": "true", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_feed_pullee": "-1", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_misdirected_ops": "false", 2024-09-16T07:39:55.147 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_no_acting_change": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_no_purge_strays": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_op_order": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_shutdown": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_trim_objects": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-16T07:39:55.148 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_verify_snaps": "false", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_deep_scrub_keys": "1024", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_deep_scrub_stride": "524288", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_default_notify_timeout": "30", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_delete_sleep": "0.000000", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-16T07:39:55.149 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_discard_disconnected_ops": "true", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_ec_partial_reads": "true", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_enable_op_tracker": "true", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_fast_info": "true", 2024-09-16T07:39:55.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_fast_shutdown": "true", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_function_tracing": "false", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_heartbeat_grace": "20", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_heartbeat_interval": "6", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_heartbeat_min_peers": "10", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_heartbeat_min_size": "2000", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_heartbeat_stale": "600", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-16T07:39:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_hit_set_max_size": "100000", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_hit_set_min_size": "1000", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_journal_size": "5120", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_kill_backfill_at": "0", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_map_cache_size": "50", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_map_dedup": "true", 2024-09-16T07:39:55.152 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_map_message_max": "40", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_map_share_max_epochs": "40", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_attr_name_len": "100", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_attr_size": "0", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_backfills": "1", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_markdown_count": "5", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_markdown_period": "600", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_object_name_len": "2048", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_object_namespace_len": "256", 2024-09-16T07:39:55.153 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_object_size": "134217728", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_pg_blocked_by": "16", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_pg_log_entries": "10000", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_pgls": "1024", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_push_cost": "8388608", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_push_objects": "10", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_scrubs": "3", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_trimming_pgs": "2", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_write_op_reply_len": "64", 2024-09-16T07:39:55.154 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_max_write_size": "90", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_profile": "balanced", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-16T07:39:55.155 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_memory_base": "805306368", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_memory_cache_min": "134217728", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-16T07:39:55.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_memory_target": "4294967296", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_memory_target_autotune": "false", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_min_pg_log_entries": "250", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_min_recovery_priority": "0", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mon_report_interval": "5", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_num_cache_shards": "32", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_num_op_tracker_shard": "32", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_numa_auto_affinity": "true", 2024-09-16T07:39:55.157 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_numa_node": "-1", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_numa_prefer_iface": "true", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_objecter_finishers": "1", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_objectstore": "bluestore", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_objectstore_fuse": "false", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_objectstore_tracing": "false", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_complaint_time": "30.000000", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_history_duration": "600", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_history_size": "20", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_history_slow_op_size": "20", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-16T07:39:55.158 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_log_threshold": "5", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_num_shards": "0", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_num_shards_hdd": "5", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_num_shards_ssd": "8", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_pq_min_cost": "65536", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_queue_cut_off": "high", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_op_thread_timeout": "15", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_open_classes_on_start": "true", 2024-09-16T07:39:55.159 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_os_flags": "0", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_peering_op_priority": "255", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_delete_cost": "1048576", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_delete_priority": "5", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_log_trim_max": "10000", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_log_trim_min": "100", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-16T07:39:55.160 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_crimson": "true", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-16T07:39:55.161 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_flags": "0", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_min_size": "2", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_pg_num": "32", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_pgp_num": "0", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_read_ratio": "70", 2024-09-16T07:39:55.162 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_size": "3", 2024-09-16T07:39:55.163 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_default_type": "replicated", 2024-09-16T07:39:55.163 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-16T07:39:55.163 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-16T07:39:55.163 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_push_per_object_cost": "1000", 2024-09-16T07:39:55.163 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-16T07:39:55.163 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recover_clone_overlap": "true", 2024-09-16T07:39:55.163 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-16T07:39:55.163 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_cost": "20971520", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_max_active": "0", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_max_single_start": "1", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_op_priority": "3", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_priority": "5", 2024-09-16T07:39:55.164 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-16T07:39:55.165 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_sleep": "0.000000", 2024-09-16T07:39:55.165 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-16T07:39:55.165 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-16T07:39:55.165 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-16T07:39:55.165 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_repair_during_recovery": "false", 2024-09-16T07:39:55.165 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_requested_scrub_priority": "120", 2024-09-16T07:39:55.165 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-16T07:39:55.165 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_auto_repair": "false", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_begin_hour": "0", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_begin_week_day": "0", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_chunk_max": "25", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_chunk_min": "5", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_cost": "52428800", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_during_recovery": "false", 2024-09-16T07:39:55.166 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_end_hour": "0", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_end_week_day": "0", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_event_cost": "4096", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_invalid_stats": "true", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_max_preemptions": "5", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_priority": "5", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_retry_delay": "30", 2024-09-16T07:39:55.167 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_retry_trimming": "10", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_scrub_sleep": "0.000000", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_skip_data_digest": "false", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_smart_report_timeout": "5", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_snap_trim_cost": "1048576", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_snap_trim_priority": "5", 2024-09-16T07:39:55.168 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_target_transaction_size": "30", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-16T07:39:55.169 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_tracing": "false", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_use_stale_snap": "false", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-16T07:39:55.170 INFO:teuthology.orchestra.run.smithi137.stdout: "osdc_blkin_trace_all": "false", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_kill_at": "0", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_max_join_drift": "10", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_min": "500", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_min_wait": "0.050000", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_propose_interval": "1.000000", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_service_trim_max": "500", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_service_trim_min": "10", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_stash_full_interval": "25", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_trim_max": "500", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "paxos_trim_min": "250", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "perf": "true", 2024-09-16T07:39:55.171 INFO:teuthology.orchestra.run.smithi137.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "public_addr": "-", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "public_addrv": "", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "public_bind_addr": "-", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "public_network": "", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "public_network_interface": "", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "qat_compressor_busy_polling": "false", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "qat_compressor_enabled": "false", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "qat_compressor_session_max_number": "256", 2024-09-16T07:39:55.172 INFO:teuthology.orchestra.run.smithi137.stdout: "rados_mon_op_timeout": "0", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rados_osd_op_timeout": "0", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rados_tracing": "false", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_atime_update_interval": "60", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_balance_parent_reads": "false", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_balance_snap_reads": "false", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_blkin_trace_all": "false", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache": "true", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-16T07:39:55.173 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache_policy": "writearound", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache_size": "33554432", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_clone_copy_on_read": "false", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_compression_hint": "none", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_concurrent_management_ops": "10", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-16T07:39:55.174 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_clone_format": "auto", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_data_pool": "", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_features": "61", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_format": "2", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_map_options": "", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_order": "22", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_pool": "rbd", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_stripe_count": "0", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_default_stripe_unit": "0", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_enable_alloc_hint": "true", 2024-09-16T07:39:55.175 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_io_scheduler": "simple", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_order": "24", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_pool": "", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_journal_splay_width": "4", 2024-09-16T07:39:55.176 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_localize_parent_reads": "false", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_localize_snap_reads": "false", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-16T07:39:55.177 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-16T07:39:55.178 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_mtime_update_interval": "60", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_non_blocking_aio": "true", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_op_thread_timeout": "60", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_op_threads": "1", 2024-09-16T07:39:55.179 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_parent_cache_enabled": "false", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_plugins": "", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_bps_burst": "0", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_bps_limit": "0", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_exclude_ops": "0", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_iops_burst": "0", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_iops_limit": "0", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-16T07:39:55.180 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_read_from_replica_policy": "default", 2024-09-16T07:39:55.181 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_skip_partial_discard": "true", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_tracing": "false", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_validate_names": "true", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rbd_validate_pool": "true", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "restapi_base_url": "", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "restapi_log_level": "", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-16T07:39:55.182 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_acl_grants_max_num": "100", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_admin_entry": "admin", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_asio_assert_yielding": "false", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_backend_store": "rados", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_barbican_url": "", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_beast_enable_async": "true", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_counters_cache": "false", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-16T07:39:55.183 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_cache_enabled": "true", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_cache_expiry_interval": "900", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_cache_lru_size": "25000", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_config_store": "rados", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_content_length_compat": "false", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_copy_obj_progress": "true", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_cors_rules_max_num": "100", 2024-09-16T07:39:55.184 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_cross_domain_policy": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_kmip_addr": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_kmip_password": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_kmip_username": "", 2024-09-16T07:39:55.185 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_require_ssl": "true", 2024-09-16T07:39:55.186 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-16T07:39:55.186 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-16T07:39:55.186 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-16T07:39:55.186 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-16T07:39:55.186 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-16T07:39:55.186 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-16T07:39:55.186 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-16T07:39:55.186 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_addr": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_auth": "token", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_namespace": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_prefix": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-16T07:39:55.187 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_token_file": "", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_curl_buffersize": "524288", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_curl_low_speed_time": "300", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-16T07:39:55.188 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-16T07:39:55.189 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_data_log_changes_size": "1000", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_data_log_num_shards": "128", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_data_log_window": "30", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-16T07:39:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_disable_s3select": "false", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-16T07:39:55.191 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dns_name": "", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dns_s3website_name": "", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dynamic_resharding": "true", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enable_gc_threads": "true", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enable_lc_threads": "true", 2024-09-16T07:39:55.192 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enable_mdsearch": "true", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enable_ops_log": "false", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enable_quota_threads": "true", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enable_static_website": "false", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enable_usage_log": "false", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_enforce_swift_acls": "true", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_exit_timeout_secs": "120", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_expose_bucket": "false", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_extended_http_attrs": "", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_filter": "none", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_frontends": "beast port=7480", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-16T07:39:55.193 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_max_deferred": "50", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_max_objs": "32", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_gc_processor_period": "3600", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_init_timeout": "300", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-16T07:39:55.194 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_kafka_connection_idle": "300", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_admin_domain": "", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_admin_password": "", 2024-09-16T07:39:55.195 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_admin_password_path": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_admin_project": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_admin_tenant": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_admin_token": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_admin_token_path": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_admin_user": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_barbican_domain": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_barbican_password": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_barbican_project": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_barbican_user": "", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-16T07:39:55.196 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_url": "", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lc_debug_interval": "-1", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lc_lock_max_time": "90", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lc_max_objs": "32", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lc_max_rules": "1000", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lc_max_worker": "3", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lc_thread_delay": "0", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-16T07:39:55.197 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ldap_dnattr": "uid", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ldap_searchfilter": "", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ldap_uri": "", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_log_http_headers": "", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_log_object_name_utc": "false", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-16T07:39:55.198 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_attr_name_len": "0", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_attr_size": "0", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_chunk_size": "4194304", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_listing_results": "5000", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_notify_retries": "10", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_put_param_size": "1048576", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_put_size": "5368709120", 2024-09-16T07:39:55.199 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_max_slo_entries": "1000", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_md_log_max_shards": "64", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_mp_lock_max_time": "600", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-16T07:39:55.200 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_max_gc": "300", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_num_async_rados_threads": "32", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_num_control_oids": "8", 2024-09-16T07:39:55.201 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_numa_node": "-1", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_objexp_chunk_size": "100", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_objexp_gc_interval": "600", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_op_thread_timeout": "600", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_op_tracing": "false", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_opa_token": "", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_opa_url": "", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_opa_verify_ssl": "true", 2024-09-16T07:39:55.202 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ops_log_rados": "false", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_ops_log_socket_path": "", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_period_push_interval": "2.000000", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_posix_cache_lanes": "3", 2024-09-16T07:39:55.203 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_posix_cache_partitions": "3", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_print_continue": "true", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_rados_tracing": "false", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_realm": "", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_realm_id": "", 2024-09-16T07:39:55.204 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_region": "", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_request_uri": "", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshard_batch_size": "64", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshard_max_aio": "128", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshard_num_logs": "16", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-16T07:39:55.205 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshard_thread_interval": "600", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_resolve_cname": "false", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_run_sync_thread": "true", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-16T07:39:55.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_scheduler_type": "throttler", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_script_uri": "", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_service_provider_name": "", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sts_client_id": "", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sts_client_secret": "", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sts_entry": "sts", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sts_key": "sts", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sts_min_session_duration": "900", 2024-09-16T07:39:55.207 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sts_token_introspection_url": "", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_account_in_url": "false", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_auth_entry": "auth", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_auth_url": "", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_custom_header": "", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_need_stats": "true", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_tenant_name": "", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_token_expiration": "86400", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_url": "", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_url_prefix": "swift", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-16T07:39:55.208 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_lease_period": "120", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_thread_pool_size": "512", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-16T07:39:55.209 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_torrent_comment": "", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_torrent_createby": "", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_torrent_encoding": "", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_torrent_flag": "false", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_torrent_origin": "", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_torrent_tracker": "", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_trust_forwarded_https": "false", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-16T07:39:55.210 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_usage_max_shards": "32", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_usage_max_user_shards": "1", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_use_opa_authz": "false", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_counters_cache": "false", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_max_buckets": "1000", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_policies_max_num": "100", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_user_unique_email": "true", 2024-09-16T07:39:55.211 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_verify_ssl": "true", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_zone": "", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_zone_id": "", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_zonegroup": "", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_zonegroup_id": "", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgwlc_auto_session_clear": "true", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_block_size": "4096", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-16T07:39:55.212 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cache_size": "536870912", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_index_type": "binary_search", 2024-09-16T07:39:55.213 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_partition_filters": "false", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_perf": "false", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "run_dir": "/var/run/ceph", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_block_create": "true", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_cache_lru_size": "67108864", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-16T07:39:55.214 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_default_max_object_size": "16777216", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_device_size": "53687091200", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_full_integrity_check": "false", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_journal_batch_capacity": "16", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_main_device_type": "SSD", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-16T07:39:55.215 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "seastore_segment_size": "67108864", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "set_keepcaps": "false", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "setgroup": "", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "setuser": "", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "setuser_match_path": "", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "thp": "false", 2024-09-16T07:39:55.216 INFO:teuthology.orchestra.run.smithi137.stdout: "threadpool_default_timeout": "60", 2024-09-16T07:39:55.217 INFO:teuthology.orchestra.run.smithi137.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-16T07:39:55.217 INFO:teuthology.orchestra.run.smithi137.stdout: "throttler_perf_counter": "true", 2024-09-16T07:39:55.217 INFO:teuthology.orchestra.run.smithi137.stdout: "tmp_dir": "/tmp", 2024-09-16T07:39:55.217 INFO:teuthology.orchestra.run.smithi137.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-16T07:39:55.217 INFO:teuthology.orchestra.run.smithi137.stdout: "uadk_compressor_enabled": "false", 2024-09-16T07:39:55.217 INFO:teuthology.orchestra.run.smithi137.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-16T07:39:55.217 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-16T07:39:55.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-16T07:39:55.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:55.323+0000 7ff133311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:55.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:55.329+0000 7ff133311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:55.342 INFO:teuthology.orchestra.run.smithi137.stdout:{} 2024-09-16T07:39:55.342 INFO:teuthology.orchestra.run.smithi137.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T07:39:55.353 DEBUG:teuthology.orchestra.run.smithi170:> type ceph-objectstore-tool 2024-09-16T07:39:55.371 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T07:39:55.372 DEBUG:teuthology.orchestra.run.smithi137:> type ceph-objectstore-tool 2024-09-16T07:39:55.386 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-16T07:39:55.386 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-16T07:39:55.396 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:39:55.397 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:39:55.398 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-16T07:39:55.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-16T07:39:55.398 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-16T07:39:55.398 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:39:55.398 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:39:55.399 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:39:55.399 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-16T07:39:55.399 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:39:55.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:55.538+0000 7f6e2cf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:55.538+0000 7ff019893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:55.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:55.544+0000 7f6e2cf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:55.546+0000 7ff019893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:55.538+0000 7fb302b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:55.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:55.552+0000 7fb302b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:55.746 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:39:55.746 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:39:55.759 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-16T07:39:55.698564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":671744,"data_stored":1896065,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.460118"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.748319+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:50.748319+0000","last_peered":"2024-09-16T07:39:50.748319+0000","last_clean":"2024-09-16T07:39:50.748319+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:50.748319+0000","last_undegraded":"2024-09-16T07:39:50.748319+0000","last_fullsized":"2024-09-16T07:39:50.748319+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749030+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:50.749030+0000","last_peered":"2024-09-16T07:39:50.749030+0000","last_clean":"2024-09-16T07:39:50.749030+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:50.749030+0000","last_undegraded":"2024-09-16T07:39:50.749030+0000","last_fullsized":"2024-09-16T07:39:50.749030+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755771+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:50.755771+0000","last_peered":"2024-09-16T07:39:50.755771+0000","last_clean":"2024-09-16T07:39:50.755771+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:50.755771+0000","last_undegraded":"2024-09-16T07:39:50.755771+0000","last_fullsized":"2024-09-16T07:39:50.755771+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755068+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:50.755068+0000","last_peered":"2024-09-16T07:39:50.755068+0000","last_clean":"2024-09-16T07:39:50.755068+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:50.755068+0000","last_undegraded":"2024-09-16T07:39:50.755068+0000","last_fullsized":"2024-09-16T07:39:50.755068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.757219+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:50.757219+0000","last_peered":"2024-09-16T07:39:50.757219+0000","last_clean":"2024-09-16T07:39:50.757219+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:50.757219+0000","last_undegraded":"2024-09-16T07:39:50.757219+0000","last_fullsized":"2024-09-16T07:39:50.757219+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.750733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:50.750733+0000","last_peered":"2024-09-16T07:39:50.750733+0000","last_clean":"2024-09-16T07:39:50.750733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:50.750733+0000","last_undegraded":"2024-09-16T07:39:50.750733+0000","last_fullsized":"2024-09-16T07:39:50.750733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749786+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:50.749786+0000","last_peered":"2024-09-16T07:39:50.749786+0000","last_clean":"2024-09-16T07:39:50.749786+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:50.749786+0000","last_undegraded":"2024-09-16T07:39:50.749786+0000","last_fullsized":"2024-09-16T07:39:50.749786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.754893+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:50.754893+0000","last_peered":"2024-09-16T07:39:50.754893+0000","last_clean":"2024-09-16T07:39:50.754893+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:50.754893+0000","last_undegraded":"2024-09-16T07:39:50.754893+0000","last_fullsized":"2024-09-16T07:39:50.754893+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":85,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.751147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:50.751147+0000","last_peered":"2024-09-16T07:39:50.751147+0000","last_clean":"2024-09-16T07:39:50.751147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:50.751147+0000","last_undegraded":"2024-09-16T07:39:50.751147+0000","last_fullsized":"2024-09-16T07:39:50.751147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":31245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":180224,"data_stored":621594,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:39:55.991 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_0' created 2024-09-16T07:39:56.012 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-16T07:39:56.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:56.135+0000 7fa93cf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:56.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:56.149+0000 7fa93cf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:56.995 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-16T07:39:57.653 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:39:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:57.759+0000 7f5c4d2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:39:57.764+0000 7f5c4d2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:39:58.014 DEBUG:teuthology.orchestra.run.smithi137:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-09-16T07:39:58.016 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:39:58.016 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:39:58.080 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:hints = 1 2024-09-16T07:39:58.080 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:39:58.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object prefix: benchmark_data_smithi137_30171 2024-09-16T07:39:58.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:39:58.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:39:59.080 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 1 16 201 185 1.44523 1.44531 0.0515793 0.0834646 2024-09-16T07:39:59.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:00.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:00.003+0000 7f5810ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:00.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:00.010+0000 7f5810ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:00.080 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 2 16 397 381 1.48817 1.53125 0.132094 0.0818382 2024-09-16T07:40:00.760 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:00.761 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:00.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:40:00.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:00.909+0000 7f20a4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:00.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:00.920+0000 7f20a4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:01.080 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 3 16 587 571 1.48686 1.48438 0.0871452 0.0823056 2024-09-16T07:40:01.255 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:40:01.255 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:40:01.278 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-09-16T07:39:59.699389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108032,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379328,"statfs":{"total":386547056640,"available":386436431872,"internally_reserved":0,"allocated":671744,"data_stored":1896065,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001278"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":85,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.751147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:50.751147+0000","last_peered":"2024-09-16T07:39:50.751147+0000","last_clean":"2024-09-16T07:39:50.751147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:50.751147+0000","last_undegraded":"2024-09-16T07:39:50.751147+0000","last_fullsized":"2024-09-16T07:39:50.751147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.754893+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:50.754893+0000","last_peered":"2024-09-16T07:39:50.754893+0000","last_clean":"2024-09-16T07:39:50.754893+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:50.754893+0000","last_undegraded":"2024-09-16T07:39:50.754893+0000","last_fullsized":"2024-09-16T07:39:50.754893+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749786+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:50.749786+0000","last_peered":"2024-09-16T07:39:50.749786+0000","last_clean":"2024-09-16T07:39:50.749786+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:50.749786+0000","last_undegraded":"2024-09-16T07:39:50.749786+0000","last_fullsized":"2024-09-16T07:39:50.749786+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.750733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:50.750733+0000","last_peered":"2024-09-16T07:39:50.750733+0000","last_clean":"2024-09-16T07:39:50.750733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:50.750733+0000","last_undegraded":"2024-09-16T07:39:50.750733+0000","last_fullsized":"2024-09-16T07:39:50.750733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.757219+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:50.757219+0000","last_peered":"2024-09-16T07:39:50.757219+0000","last_clean":"2024-09-16T07:39:50.757219+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:50.757219+0000","last_undegraded":"2024-09-16T07:39:50.757219+0000","last_fullsized":"2024-09-16T07:39:50.757219+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755068+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:50.755068+0000","last_peered":"2024-09-16T07:39:50.755068+0000","last_clean":"2024-09-16T07:39:50.755068+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:50.755068+0000","last_undegraded":"2024-09-16T07:39:50.755068+0000","last_fullsized":"2024-09-16T07:39:50.755068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.755771+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:50.755771+0000","last_peered":"2024-09-16T07:39:50.755771+0000","last_clean":"2024-09-16T07:39:50.755771+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:50.755771+0000","last_undegraded":"2024-09-16T07:39:50.755771+0000","last_fullsized":"2024-09-16T07:39:50.755771+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.749030+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:50.749030+0000","last_peered":"2024-09-16T07:39:50.749030+0000","last_clean":"2024-09-16T07:39:50.749030+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:50.749030+0000","last_undegraded":"2024-09-16T07:39:50.749030+0000","last_fullsized":"2024-09-16T07:39:50.749030+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:39:55.989577+0000","last_change":"2024-09-16T07:39:55.989577+0000","last_active":"2024-09-16T07:39:55.989577+0000","last_peered":"2024-09-16T07:39:55.989577+0000","last_clean":"2024-09-16T07:39:55.989577+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:39:55.989577+0000","last_undegraded":"2024-09-16T07:39:55.989577+0000","last_fullsized":"2024-09-16T07:39:55.989577+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-16T07:39:50.748319+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:50.748319+0000","last_peered":"2024-09-16T07:39:50.748319+0000","last_clean":"2024-09-16T07:39:50.748319+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:50.748319+0000","last_undegraded":"2024-09-16T07:39:50.748319+0000","last_fullsized":"2024-09-16T07:39:50.748319+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":31245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":184320,"data_stored":621613,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":180224,"data_stored":621594,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:40:02.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 4 16 767 751 1.46667 1.40625 0.0721781 0.0840378 2024-09-16T07:40:02.213 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:02.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:02.377+0000 7f798c674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:02.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:02.383+0000 7f798c674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:03.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 5 16 944 928 1.44988 1.38281 0.0469757 0.0848922 2024-09-16T07:40:04.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 6 16 1126 1110 1.44519 1.42188 0.048986 0.0860321 2024-09-16T07:40:04.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:04.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:04.686+0000 7fd6b54e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:04.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:04.693+0000 7fd6b54e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:05.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 7 16 1292 1276 1.42399 1.29688 0.0385296 0.0866438 2024-09-16T07:40:06.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 8 16 1479 1463 1.42859 1.46094 0.0848183 0.0868511 2024-09-16T07:40:06.280 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:06.280 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:06.281 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:40:06.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:40:06.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:06.446+0000 7fb71cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:06.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:06.460+0000 7fb71cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:06.530 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:06.530 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:06.530 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:06.530 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:06.534 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:06.534 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:06.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:40:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:06.691+0000 7fb87387d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:06.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:06.708+0000 7fb87387d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:06.760 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:06.761 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:06.764 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:06.764 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:06.764 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:40:06.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:06.913+0000 7f8a78591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:06.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:06.924+0000 7f8a78591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:07.017 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:07.080 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:07.080 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:07.080 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:07.080 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:07.080 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:07.080 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:07.080 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:07.080 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:07.081 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:07.081 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:07.081 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:07.081 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:07.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 9 16 1668 1652 1.43391 1.47656 0.0696606 0.0869536 2024-09-16T07:40:07.083 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:07.083 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:07.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:40:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:07.161+0000 7fb4d9d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:07.169+0000 7fb4d9d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:07.251+0000 7fc8070ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:07.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:07.266+0000 7fc8070ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:07.292 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:07.293 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:08.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 10 16 1834 1818 1.4202 1.29688 0.0889135 0.087705 2024-09-16T07:40:09.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 11 15 1999 1984 1.40898 1.29688 0.13615 0.0880791 2024-09-16T07:40:09.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:09.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:09.955+0000 7f96bb25c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:09.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:09.962+0000 7f96bb25c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:10.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 12 16 2181 2165 1.40939 1.41406 0.0474575 0.0881391 2024-09-16T07:40:11.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 13 16 2363 2347 1.41034 1.42188 0.0554381 0.0881714 2024-09-16T07:40:12.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 14 16 2534 2518 1.40502 1.33594 0.100182 0.0885703 2024-09-16T07:40:12.294 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:12.294 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:12.294 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:40:12.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:40:12.313 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:12.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:12.419+0000 7fa6bd67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:12.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:12.430+0000 7fa6bd67f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:12.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:12.488+0000 7f6e98d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:12.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:12.495+0000 7f6e98d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:12.500 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:12.500 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:12.501 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:12.505 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:12.505 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:12.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:40:12.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:12.641+0000 7fec7fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:12.656+0000 7fec7fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:12.708 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:12.709 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:12.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:40:12.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:12.849+0000 7f1a9fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:12.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:12.861+0000 7f1a9fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:12.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:12.993 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:12.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:40:13.081 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 15 16 2707 2691 1.40145 1.35156 0.0579141 0.088883 2024-09-16T07:40:13.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:13.136+0000 7fde33591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:13.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:13.153+0000 7fde33591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:13.246 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:13.247 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:13.249 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:13.249 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:14.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 16 16 2874 2858 1.39539 1.30469 0.0609401 0.0893946 2024-09-16T07:40:14.789 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:14.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:14.908+0000 7f1f30511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:14.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:14.915+0000 7f1f30511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:15.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 17 16 3065 3049 1.40108 1.49219 0.0518209 0.0889299 2024-09-16T07:40:16.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 18 16 3246 3230 1.40179 1.41406 0.124909 0.088886 2024-09-16T07:40:17.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 19 16 3430 3414 1.40367 1.4375 0.0697629 0.0888423 2024-09-16T07:40:17.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:17.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:17.432+0000 7fb244b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:17.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:17.442+0000 7fb244b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:18.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:40:18.083746+0000 min lat: 0.0185115 max lat: 0.278092 avg lat: 0.0888138 2024-09-16T07:40:18.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:40:18.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 20 16 3612 3596 1.40457 1.42188 0.0316191 0.0888138 2024-09-16T07:40:18.250 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:18.251 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:18.251 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:40:18.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:40:18.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:18.399+0000 7f242d463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:18.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:18.412+0000 7f242d463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:18.568 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:18.569 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:18.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:18.572 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:18.572 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:40:18.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:18.692+0000 7f7b1f711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:18.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:18.703+0000 7f7b1f711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:18.807 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:18.807 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:18.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:40:18.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:18.939+0000 7f6407191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:18.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:18.951+0000 7f6407191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:18.979 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:18.979 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:18.979 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:18.980 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:18.983 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:18.983 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:18.983 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:40:19.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 21 16 3762 3746 1.39348 1.17188 0.119556 0.0895553 2024-09-16T07:40:19.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:19.124+0000 7f98c3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:19.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:19.136+0000 7f98c3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:19.250 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:19.251 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:19.255 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:19.255 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:19.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:19.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:19.824+0000 7f4bdfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:19.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:19.835+0000 7f4bdfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:20.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 22 15 3926 3911 1.38873 1.28906 0.0818231 0.0897865 2024-09-16T07:40:21.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 23 16 4108 4092 1.38983 1.41406 0.0444239 0.0897443 2024-09-16T07:40:22.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 24 16 4256 4240 1.38009 1.15625 0.156665 0.0902276 2024-09-16T07:40:22.166 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:22.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:22.298+0000 7fa167d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:22.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:22.304+0000 7fa167d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:23.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 25 16 4411 4395 1.37332 1.21094 0.126002 0.0906444 2024-09-16T07:40:24.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 26 16 4585 4569 1.37278 1.35938 0.0355924 0.0908424 2024-09-16T07:40:24.256 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:24.256 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:24.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:40:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:24.401+0000 7f4ddb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:24.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:24.412+0000 7f4ddb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:24.522 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:24.641 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:40:24.642 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:40:24.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:24.656+0000 7f83ebf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:24.665 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-16T07:40:23.703526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25182771,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3083,"num_write_kb":25124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3057,"ondisk_log_size":3057,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176804,"kb_used_data":36188,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377310556,"statfs":{"total":386547056640,"available":386366009344,"internally_reserved":0,"allocated":37056512,"data_stored":74512377,"data_compressed":3834138,"data_compressed_allocated":36409344,"data_compressed_original":74293248,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24592384,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3002,"num_write_kb":24016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002098"},"pg_stats":[{"pgid":"3.f","version":"17'232","reported_seq":244,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.298240+0000","last_change":"2024-09-16T07:39:57.153006+0000","last_active":"2024-09-16T07:40:14.298240+0000","last_peered":"2024-09-16T07:40:14.298240+0000","last_clean":"2024-09-16T07:40:14.298240+0000","last_became_active":"2024-09-16T07:39:57.142405+0000","last_became_peered":"2024-09-16T07:39:57.142405+0000","last_unstale":"2024-09-16T07:40:14.298240+0000","last_undegraded":"2024-09-16T07:40:14.298240+0000","last_fullsized":"2024-09-16T07:40:14.298240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'186","reported_seq":198,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.739932+0000","last_change":"2024-09-16T07:39:57.210052+0000","last_active":"2024-09-16T07:40:14.739932+0000","last_peered":"2024-09-16T07:40:14.739932+0000","last_clean":"2024-09-16T07:40:14.739932+0000","last_became_active":"2024-09-16T07:39:57.203399+0000","last_became_peered":"2024-09-16T07:39:57.203399+0000","last_unstale":"2024-09-16T07:40:14.739932+0000","last_undegraded":"2024-09-16T07:40:14.739932+0000","last_fullsized":"2024-09-16T07:40:14.739932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523712,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'120","reported_seq":132,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.426774+0000","last_change":"2024-09-16T07:39:57.124065+0000","last_active":"2024-09-16T07:40:14.426774+0000","last_peered":"2024-09-16T07:40:14.426774+0000","last_clean":"2024-09-16T07:40:14.426774+0000","last_became_active":"2024-09-16T07:39:57.114008+0000","last_became_peered":"2024-09-16T07:39:57.114008+0000","last_unstale":"2024-09-16T07:40:14.426774+0000","last_undegraded":"2024-09-16T07:40:14.426774+0000","last_fullsized":"2024-09-16T07:40:14.426774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"17'224","reported_seq":236,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.408522+0000","last_change":"2024-09-16T07:39:57.138304+0000","last_active":"2024-09-16T07:40:14.408522+0000","last_peered":"2024-09-16T07:40:14.408522+0000","last_clean":"2024-09-16T07:40:14.408522+0000","last_became_active":"2024-09-16T07:39:57.131604+0000","last_became_peered":"2024-09-16T07:39:57.131604+0000","last_unstale":"2024-09-16T07:40:14.408522+0000","last_undegraded":"2024-09-16T07:40:14.408522+0000","last_fullsized":"2024-09-16T07:40:14.408522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"17'192","reported_seq":204,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.199090+0000","last_change":"2024-09-16T07:39:57.223458+0000","last_active":"2024-09-16T07:40:14.199090+0000","last_peered":"2024-09-16T07:40:14.199090+0000","last_clean":"2024-09-16T07:40:14.199090+0000","last_became_active":"2024-09-16T07:39:57.216826+0000","last_became_peered":"2024-09-16T07:39:57.216826+0000","last_unstale":"2024-09-16T07:40:14.199090+0000","last_undegraded":"2024-09-16T07:40:14.199090+0000","last_fullsized":"2024-09-16T07:40:14.199090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"17'208","reported_seq":220,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.741757+0000","last_change":"2024-09-16T07:39:57.146386+0000","last_active":"2024-09-16T07:40:14.741757+0000","last_peered":"2024-09-16T07:40:14.741757+0000","last_clean":"2024-09-16T07:40:14.741757+0000","last_became_active":"2024-09-16T07:39:57.140054+0000","last_became_peered":"2024-09-16T07:39:57.140054+0000","last_unstale":"2024-09-16T07:40:14.741757+0000","last_undegraded":"2024-09-16T07:40:14.741757+0000","last_fullsized":"2024-09-16T07:40:14.741757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"17'264","reported_seq":276,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:12.737143+0000","last_change":"2024-09-16T07:39:57.170896+0000","last_active":"2024-09-16T07:40:12.737143+0000","last_peered":"2024-09-16T07:40:12.737143+0000","last_clean":"2024-09-16T07:40:12.737143+0000","last_became_active":"2024-09-16T07:39:57.162445+0000","last_became_peered":"2024-09-16T07:39:57.162445+0000","last_unstale":"2024-09-16T07:40:12.737143+0000","last_undegraded":"2024-09-16T07:40:12.737143+0000","last_fullsized":"2024-09-16T07:40:12.737143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"17'160","reported_seq":172,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.095614+0000","last_change":"2024-09-16T07:39:57.113233+0000","last_active":"2024-09-16T07:40:14.095614+0000","last_peered":"2024-09-16T07:40:14.095614+0000","last_clean":"2024-09-16T07:40:14.095614+0000","last_became_active":"2024-09-16T07:39:57.103200+0000","last_became_peered":"2024-09-16T07:39:57.103200+0000","last_unstale":"2024-09-16T07:40:14.095614+0000","last_undegraded":"2024-09-16T07:40:14.095614+0000","last_fullsized":"2024-09-16T07:40:14.095614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":94,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.010575+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:58.010575+0000","last_peered":"2024-09-16T07:39:58.010575+0000","last_clean":"2024-09-16T07:39:58.010575+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:58.010575+0000","last_undegraded":"2024-09-16T07:39:58.010575+0000","last_fullsized":"2024-09-16T07:39:58.010575+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016917+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:58.016917+0000","last_peered":"2024-09-16T07:39:58.016917+0000","last_clean":"2024-09-16T07:39:58.016917+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:58.016917+0000","last_undegraded":"2024-09-16T07:39:58.016917+0000","last_fullsized":"2024-09-16T07:39:58.016917+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'184","reported_seq":196,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:12.553297+0000","last_change":"2024-09-16T07:39:57.156383+0000","last_active":"2024-09-16T07:40:12.553297+0000","last_peered":"2024-09-16T07:40:12.553297+0000","last_clean":"2024-09-16T07:40:12.553297+0000","last_became_active":"2024-09-16T07:39:57.147931+0000","last_became_peered":"2024-09-16T07:39:57.147931+0000","last_unstale":"2024-09-16T07:40:12.553297+0000","last_undegraded":"2024-09-16T07:40:12.553297+0000","last_fullsized":"2024-09-16T07:40:12.553297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.011429+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:58.011429+0000","last_peered":"2024-09-16T07:39:58.011429+0000","last_clean":"2024-09-16T07:39:58.011429+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:58.011429+0000","last_undegraded":"2024-09-16T07:39:58.011429+0000","last_fullsized":"2024-09-16T07:39:58.011429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"17'216","reported_seq":228,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.557365+0000","last_change":"2024-09-16T07:39:57.167637+0000","last_active":"2024-09-16T07:40:14.557365+0000","last_peered":"2024-09-16T07:40:14.557365+0000","last_clean":"2024-09-16T07:40:14.557365+0000","last_became_active":"2024-09-16T07:39:57.153421+0000","last_became_peered":"2024-09-16T07:39:57.153421+0000","last_unstale":"2024-09-16T07:40:14.557365+0000","last_undegraded":"2024-09-16T07:40:14.557365+0000","last_fullsized":"2024-09-16T07:40:14.557365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.015132+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:58.015132+0000","last_peered":"2024-09-16T07:39:58.015132+0000","last_clean":"2024-09-16T07:39:58.015132+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:58.015132+0000","last_undegraded":"2024-09-16T07:39:58.015132+0000","last_fullsized":"2024-09-16T07:39:58.015132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'232","reported_seq":244,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.368945+0000","last_change":"2024-09-16T07:39:57.140655+0000","last_active":"2024-09-16T07:40:14.368945+0000","last_peered":"2024-09-16T07:40:14.368945+0000","last_clean":"2024-09-16T07:40:14.368945+0000","last_became_active":"2024-09-16T07:39:57.125541+0000","last_became_peered":"2024-09-16T07:39:57.125541+0000","last_unstale":"2024-09-16T07:40:14.368945+0000","last_undegraded":"2024-09-16T07:40:14.368945+0000","last_fullsized":"2024-09-16T07:40:14.368945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.018441+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:58.018441+0000","last_peered":"2024-09-16T07:39:58.018441+0000","last_clean":"2024-09-16T07:39:58.018441+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:58.018441+0000","last_undegraded":"2024-09-16T07:39:58.018441+0000","last_fullsized":"2024-09-16T07:39:58.018441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"17'184","reported_seq":196,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.855876+0000","last_change":"2024-09-16T07:39:57.131217+0000","last_active":"2024-09-16T07:40:13.855876+0000","last_peered":"2024-09-16T07:40:13.855876+0000","last_clean":"2024-09-16T07:40:13.855876+0000","last_became_active":"2024-09-16T07:39:57.119292+0000","last_became_peered":"2024-09-16T07:39:57.119292+0000","last_unstale":"2024-09-16T07:40:13.855876+0000","last_undegraded":"2024-09-16T07:40:13.855876+0000","last_fullsized":"2024-09-16T07:40:13.855876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"17'136","reported_seq":148,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.674709+0000","last_change":"2024-09-16T07:39:57.114512+0000","last_active":"2024-09-16T07:40:14.674709+0000","last_peered":"2024-09-16T07:40:14.674709+0000","last_clean":"2024-09-16T07:40:14.674709+0000","last_became_active":"2024-09-16T07:39:57.106844+0000","last_became_peered":"2024-09-16T07:39:57.106844+0000","last_unstale":"2024-09-16T07:40:14.674709+0000","last_undegraded":"2024-09-16T07:40:14.674709+0000","last_fullsized":"2024-09-16T07:40:14.674709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.020986+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:58.020986+0000","last_peered":"2024-09-16T07:39:58.020986+0000","last_clean":"2024-09-16T07:39:58.020986+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:58.020986+0000","last_undegraded":"2024-09-16T07:39:58.020986+0000","last_fullsized":"2024-09-16T07:39:58.020986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"17'152","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.319022+0000","last_change":"2024-09-16T07:39:57.152651+0000","last_active":"2024-09-16T07:40:13.319022+0000","last_peered":"2024-09-16T07:40:13.319022+0000","last_clean":"2024-09-16T07:40:13.319022+0000","last_became_active":"2024-09-16T07:39:57.141965+0000","last_became_peered":"2024-09-16T07:39:57.141965+0000","last_unstale":"2024-09-16T07:40:13.319022+0000","last_undegraded":"2024-09-16T07:40:13.319022+0000","last_fullsized":"2024-09-16T07:40:13.319022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016791+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:58.016791+0000","last_peered":"2024-09-16T07:39:58.016791+0000","last_clean":"2024-09-16T07:39:58.016791+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:58.016791+0000","last_undegraded":"2024-09-16T07:39:58.016791+0000","last_fullsized":"2024-09-16T07:39:58.016791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'152","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.707012+0000","last_change":"2024-09-16T07:39:57.200290+0000","last_active":"2024-09-16T07:40:14.707012+0000","last_peered":"2024-09-16T07:40:14.707012+0000","last_clean":"2024-09-16T07:40:14.707012+0000","last_became_active":"2024-09-16T07:39:57.189506+0000","last_became_peered":"2024-09-16T07:39:57.189506+0000","last_unstale":"2024-09-16T07:40:14.707012+0000","last_undegraded":"2024-09-16T07:40:14.707012+0000","last_fullsized":"2024-09-16T07:40:14.707012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.013708+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:58.013708+0000","last_peered":"2024-09-16T07:39:58.013708+0000","last_clean":"2024-09-16T07:39:58.013708+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:58.013708+0000","last_undegraded":"2024-09-16T07:39:58.013708+0000","last_fullsized":"2024-09-16T07:39:58.013708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'160","reported_seq":172,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.591810+0000","last_change":"2024-09-16T07:39:57.123748+0000","last_active":"2024-09-16T07:40:13.591810+0000","last_peered":"2024-09-16T07:40:13.591810+0000","last_clean":"2024-09-16T07:40:13.591810+0000","last_became_active":"2024-09-16T07:39:57.106298+0000","last_became_peered":"2024-09-16T07:39:57.106298+0000","last_unstale":"2024-09-16T07:40:13.591810+0000","last_undegraded":"2024-09-16T07:40:13.591810+0000","last_fullsized":"2024-09-16T07:40:13.591810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.012836+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:58.012836+0000","last_peered":"2024-09-16T07:39:58.012836+0000","last_clean":"2024-09-16T07:39:58.012836+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:58.012836+0000","last_undegraded":"2024-09-16T07:39:58.012836+0000","last_fullsized":"2024-09-16T07:39:58.012836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":24592384,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3002,"num_write_kb":24016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36876288,"data_stored":73752576,"data_compressed":3804939,"data_compressed_allocated":36876288,"data_compressed_original":73752576,"omap_allocated":0,"internal_metadata":0},"log_size":3002,"ondisk_log_size":3002,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44224,"kb_used_data":9068,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327616,"statfs":{"total":96636764160,"available":96591478784,"internally_reserved":0,"allocated":9285632,"data_stored":18318443,"data_compressed":942855,"data_compressed_allocated":9138176,"data_compressed_original":18276352,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43348,"kb_used_data":8196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94328492,"statfs":{"total":96636764160,"available":96592375808,"internally_reserved":0,"allocated":8392704,"data_stored":17000075,"data_compressed":874507,"data_compressed_allocated":8224768,"data_compressed_original":16941056,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44496,"kb_used_data":9340,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327344,"statfs":{"total":96636764160,"available":96591200256,"internally_reserved":0,"allocated":9564160,"data_stored":19342987,"data_compressed":995219,"data_compressed_allocated":9396224,"data_compressed_original":19283968,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44736,"kb_used_data":9584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9814016,"data_stored":19850872,"data_compressed":1021557,"data_compressed_allocated":9650176,"data_compressed_original":19791872,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9609216,"data_stored":19218432,"data_compressed":991520,"data_compressed_allocated":9609216,"data_compressed_original":19218432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9895936,"data_stored":19791872,"data_compressed":1021018,"data_compressed_allocated":9895936,"data_compressed_original":19791872,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8200192,"data_stored":16400384,"data_compressed":846162,"data_compressed_allocated":8200192,"data_compressed_original":16400384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9170944,"data_stored":18341888,"data_compressed":946239,"data_compressed_allocated":9170944,"data_compressed_original":18341888,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:40:24.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:24.667+0000 7f83ebf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:25.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 27 16 4765 4749 1.37402 1.40625 0.0569079 0.0908634 2024-09-16T07:40:26.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 28 16 4936 4920 1.37265 1.33594 0.0522618 0.0909683 2024-09-16T07:40:27.021 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:27.082 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 29 16 5105 5089 1.37084 1.32031 0.0929221 0.091097 2024-09-16T07:40:27.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:27.164+0000 7f7e2e908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:27.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:27.170+0000 7f7e2e908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:28.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 30 16 5286 5270 1.37228 1.41406 0.0479593 0.0909664 2024-09-16T07:40:29.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 31 16 5450 5434 1.36934 1.28125 0.138433 0.0910952 2024-09-16T07:40:29.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:29.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:29.496+0000 7f5ecda6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:29.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:29.503+0000 7f5ecda6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:29.667 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:29.667 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:29.667 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:40:29.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:40:29.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:29.803+0000 7fe7b2d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:29.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:29.819+0000 7fe7b2d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:29.964 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:29.967 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:29.967 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:29.967 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:40:30.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 32 16 5644 5628 1.37391 1.51562 0.057126 0.090877 2024-09-16T07:40:30.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:30.114+0000 7f0923311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:30.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:30.125+0000 7f0923311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:30.168 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:30.169 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:30.173 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:30.173 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:30.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:40:30.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:30.322+0000 7fcaca4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:30.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:30.335+0000 7fcaca4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:30.493 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:30.493 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:30.493 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:30.493 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:30.493 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:30.494 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:30.494 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:30.494 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:30.494 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:30.494 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:30.494 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:30.494 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:30.498 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:30.498 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:30.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:40:30.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:30.646+0000 7f2014b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:30.659+0000 7f2014b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:30.682 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:30.683 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:30.683 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:30.683 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:30.683 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:30.683 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:30.683 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:30.683 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:30.683 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:30.687 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:30.688 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:31.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 33 16 5815 5799 1.37275 1.33594 0.0907471 0.0909308 2024-09-16T07:40:31.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:31.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:31.878+0000 7f0c31d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:31.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:31.886+0000 7f0c31d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:32.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 34 16 5984 5968 1.37121 1.32031 0.090929 0.0910294 2024-09-16T07:40:33.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 35 16 6167 6151 1.37287 1.42969 0.114691 0.0909042 2024-09-16T07:40:34.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 36 16 6326 6310 1.36924 1.24219 0.138548 0.0911133 2024-09-16T07:40:34.359 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:34.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:34.504+0000 7f947d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:34.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:34.512+0000 7f947d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:35.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 37 16 6501 6485 1.36918 1.36719 0.0798136 0.0911793 2024-09-16T07:40:35.689 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:35.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:35.689 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:40:35.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:35.856+0000 7efc47b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:35.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:35.866+0000 7efc47b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:36.083 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 38 16 6632 6616 1.36008 1.02344 0.24789 0.0916759 2024-09-16T07:40:36.110 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:40:36.110 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:40:36.128 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-16T07:40:35.705771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25182771,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3083,"num_write_kb":25124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3057,"ondisk_log_size":3057,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176804,"kb_used_data":36188,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377310556,"statfs":{"total":386547056640,"available":386366009344,"internally_reserved":0,"allocated":37056512,"data_stored":74512377,"data_compressed":3834138,"data_compressed_allocated":36409344,"data_compressed_original":74293248,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002244"},"pg_stats":[{"pgid":"3.f","version":"17'232","reported_seq":244,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.298240+0000","last_change":"2024-09-16T07:39:57.153006+0000","last_active":"2024-09-16T07:40:14.298240+0000","last_peered":"2024-09-16T07:40:14.298240+0000","last_clean":"2024-09-16T07:40:14.298240+0000","last_became_active":"2024-09-16T07:39:57.142405+0000","last_became_peered":"2024-09-16T07:39:57.142405+0000","last_unstale":"2024-09-16T07:40:14.298240+0000","last_undegraded":"2024-09-16T07:40:14.298240+0000","last_fullsized":"2024-09-16T07:40:14.298240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'186","reported_seq":198,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.739932+0000","last_change":"2024-09-16T07:39:57.210052+0000","last_active":"2024-09-16T07:40:14.739932+0000","last_peered":"2024-09-16T07:40:14.739932+0000","last_clean":"2024-09-16T07:40:14.739932+0000","last_became_active":"2024-09-16T07:39:57.203399+0000","last_became_peered":"2024-09-16T07:39:57.203399+0000","last_unstale":"2024-09-16T07:40:14.739932+0000","last_undegraded":"2024-09-16T07:40:14.739932+0000","last_fullsized":"2024-09-16T07:40:14.739932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523712,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'120","reported_seq":132,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.426774+0000","last_change":"2024-09-16T07:39:57.124065+0000","last_active":"2024-09-16T07:40:14.426774+0000","last_peered":"2024-09-16T07:40:14.426774+0000","last_clean":"2024-09-16T07:40:14.426774+0000","last_became_active":"2024-09-16T07:39:57.114008+0000","last_became_peered":"2024-09-16T07:39:57.114008+0000","last_unstale":"2024-09-16T07:40:14.426774+0000","last_undegraded":"2024-09-16T07:40:14.426774+0000","last_fullsized":"2024-09-16T07:40:14.426774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"17'224","reported_seq":236,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.408522+0000","last_change":"2024-09-16T07:39:57.138304+0000","last_active":"2024-09-16T07:40:14.408522+0000","last_peered":"2024-09-16T07:40:14.408522+0000","last_clean":"2024-09-16T07:40:14.408522+0000","last_became_active":"2024-09-16T07:39:57.131604+0000","last_became_peered":"2024-09-16T07:39:57.131604+0000","last_unstale":"2024-09-16T07:40:14.408522+0000","last_undegraded":"2024-09-16T07:40:14.408522+0000","last_fullsized":"2024-09-16T07:40:14.408522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"17'192","reported_seq":204,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.199090+0000","last_change":"2024-09-16T07:39:57.223458+0000","last_active":"2024-09-16T07:40:14.199090+0000","last_peered":"2024-09-16T07:40:14.199090+0000","last_clean":"2024-09-16T07:40:14.199090+0000","last_became_active":"2024-09-16T07:39:57.216826+0000","last_became_peered":"2024-09-16T07:39:57.216826+0000","last_unstale":"2024-09-16T07:40:14.199090+0000","last_undegraded":"2024-09-16T07:40:14.199090+0000","last_fullsized":"2024-09-16T07:40:14.199090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"17'208","reported_seq":220,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.741757+0000","last_change":"2024-09-16T07:39:57.146386+0000","last_active":"2024-09-16T07:40:14.741757+0000","last_peered":"2024-09-16T07:40:14.741757+0000","last_clean":"2024-09-16T07:40:14.741757+0000","last_became_active":"2024-09-16T07:39:57.140054+0000","last_became_peered":"2024-09-16T07:39:57.140054+0000","last_unstale":"2024-09-16T07:40:14.741757+0000","last_undegraded":"2024-09-16T07:40:14.741757+0000","last_fullsized":"2024-09-16T07:40:14.741757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"17'264","reported_seq":276,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:12.737143+0000","last_change":"2024-09-16T07:39:57.170896+0000","last_active":"2024-09-16T07:40:12.737143+0000","last_peered":"2024-09-16T07:40:12.737143+0000","last_clean":"2024-09-16T07:40:12.737143+0000","last_became_active":"2024-09-16T07:39:57.162445+0000","last_became_peered":"2024-09-16T07:39:57.162445+0000","last_unstale":"2024-09-16T07:40:12.737143+0000","last_undegraded":"2024-09-16T07:40:12.737143+0000","last_fullsized":"2024-09-16T07:40:12.737143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"17'160","reported_seq":172,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.095614+0000","last_change":"2024-09-16T07:39:57.113233+0000","last_active":"2024-09-16T07:40:14.095614+0000","last_peered":"2024-09-16T07:40:14.095614+0000","last_clean":"2024-09-16T07:40:14.095614+0000","last_became_active":"2024-09-16T07:39:57.103200+0000","last_became_peered":"2024-09-16T07:39:57.103200+0000","last_unstale":"2024-09-16T07:40:14.095614+0000","last_undegraded":"2024-09-16T07:40:14.095614+0000","last_fullsized":"2024-09-16T07:40:14.095614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":94,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.010575+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:58.010575+0000","last_peered":"2024-09-16T07:39:58.010575+0000","last_clean":"2024-09-16T07:39:58.010575+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:58.010575+0000","last_undegraded":"2024-09-16T07:39:58.010575+0000","last_fullsized":"2024-09-16T07:39:58.010575+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016917+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:58.016917+0000","last_peered":"2024-09-16T07:39:58.016917+0000","last_clean":"2024-09-16T07:39:58.016917+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:58.016917+0000","last_undegraded":"2024-09-16T07:39:58.016917+0000","last_fullsized":"2024-09-16T07:39:58.016917+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'184","reported_seq":196,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:12.553297+0000","last_change":"2024-09-16T07:39:57.156383+0000","last_active":"2024-09-16T07:40:12.553297+0000","last_peered":"2024-09-16T07:40:12.553297+0000","last_clean":"2024-09-16T07:40:12.553297+0000","last_became_active":"2024-09-16T07:39:57.147931+0000","last_became_peered":"2024-09-16T07:39:57.147931+0000","last_unstale":"2024-09-16T07:40:12.553297+0000","last_undegraded":"2024-09-16T07:40:12.553297+0000","last_fullsized":"2024-09-16T07:40:12.553297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.011429+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:58.011429+0000","last_peered":"2024-09-16T07:39:58.011429+0000","last_clean":"2024-09-16T07:39:58.011429+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:58.011429+0000","last_undegraded":"2024-09-16T07:39:58.011429+0000","last_fullsized":"2024-09-16T07:39:58.011429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"17'216","reported_seq":228,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.557365+0000","last_change":"2024-09-16T07:39:57.167637+0000","last_active":"2024-09-16T07:40:14.557365+0000","last_peered":"2024-09-16T07:40:14.557365+0000","last_clean":"2024-09-16T07:40:14.557365+0000","last_became_active":"2024-09-16T07:39:57.153421+0000","last_became_peered":"2024-09-16T07:39:57.153421+0000","last_unstale":"2024-09-16T07:40:14.557365+0000","last_undegraded":"2024-09-16T07:40:14.557365+0000","last_fullsized":"2024-09-16T07:40:14.557365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.015132+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:58.015132+0000","last_peered":"2024-09-16T07:39:58.015132+0000","last_clean":"2024-09-16T07:39:58.015132+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:58.015132+0000","last_undegraded":"2024-09-16T07:39:58.015132+0000","last_fullsized":"2024-09-16T07:39:58.015132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'232","reported_seq":244,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.368945+0000","last_change":"2024-09-16T07:39:57.140655+0000","last_active":"2024-09-16T07:40:14.368945+0000","last_peered":"2024-09-16T07:40:14.368945+0000","last_clean":"2024-09-16T07:40:14.368945+0000","last_became_active":"2024-09-16T07:39:57.125541+0000","last_became_peered":"2024-09-16T07:39:57.125541+0000","last_unstale":"2024-09-16T07:40:14.368945+0000","last_undegraded":"2024-09-16T07:40:14.368945+0000","last_fullsized":"2024-09-16T07:40:14.368945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.018441+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:58.018441+0000","last_peered":"2024-09-16T07:39:58.018441+0000","last_clean":"2024-09-16T07:39:58.018441+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:58.018441+0000","last_undegraded":"2024-09-16T07:39:58.018441+0000","last_fullsized":"2024-09-16T07:39:58.018441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"17'184","reported_seq":196,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.855876+0000","last_change":"2024-09-16T07:39:57.131217+0000","last_active":"2024-09-16T07:40:13.855876+0000","last_peered":"2024-09-16T07:40:13.855876+0000","last_clean":"2024-09-16T07:40:13.855876+0000","last_became_active":"2024-09-16T07:39:57.119292+0000","last_became_peered":"2024-09-16T07:39:57.119292+0000","last_unstale":"2024-09-16T07:40:13.855876+0000","last_undegraded":"2024-09-16T07:40:13.855876+0000","last_fullsized":"2024-09-16T07:40:13.855876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"17'136","reported_seq":148,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.674709+0000","last_change":"2024-09-16T07:39:57.114512+0000","last_active":"2024-09-16T07:40:14.674709+0000","last_peered":"2024-09-16T07:40:14.674709+0000","last_clean":"2024-09-16T07:40:14.674709+0000","last_became_active":"2024-09-16T07:39:57.106844+0000","last_became_peered":"2024-09-16T07:39:57.106844+0000","last_unstale":"2024-09-16T07:40:14.674709+0000","last_undegraded":"2024-09-16T07:40:14.674709+0000","last_fullsized":"2024-09-16T07:40:14.674709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.020986+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:58.020986+0000","last_peered":"2024-09-16T07:39:58.020986+0000","last_clean":"2024-09-16T07:39:58.020986+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:58.020986+0000","last_undegraded":"2024-09-16T07:39:58.020986+0000","last_fullsized":"2024-09-16T07:39:58.020986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"17'152","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.319022+0000","last_change":"2024-09-16T07:39:57.152651+0000","last_active":"2024-09-16T07:40:13.319022+0000","last_peered":"2024-09-16T07:40:13.319022+0000","last_clean":"2024-09-16T07:40:13.319022+0000","last_became_active":"2024-09-16T07:39:57.141965+0000","last_became_peered":"2024-09-16T07:39:57.141965+0000","last_unstale":"2024-09-16T07:40:13.319022+0000","last_undegraded":"2024-09-16T07:40:13.319022+0000","last_fullsized":"2024-09-16T07:40:13.319022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016791+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:58.016791+0000","last_peered":"2024-09-16T07:39:58.016791+0000","last_clean":"2024-09-16T07:39:58.016791+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:58.016791+0000","last_undegraded":"2024-09-16T07:39:58.016791+0000","last_fullsized":"2024-09-16T07:39:58.016791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'152","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.707012+0000","last_change":"2024-09-16T07:39:57.200290+0000","last_active":"2024-09-16T07:40:14.707012+0000","last_peered":"2024-09-16T07:40:14.707012+0000","last_clean":"2024-09-16T07:40:14.707012+0000","last_became_active":"2024-09-16T07:39:57.189506+0000","last_became_peered":"2024-09-16T07:39:57.189506+0000","last_unstale":"2024-09-16T07:40:14.707012+0000","last_undegraded":"2024-09-16T07:40:14.707012+0000","last_fullsized":"2024-09-16T07:40:14.707012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.013708+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:58.013708+0000","last_peered":"2024-09-16T07:39:58.013708+0000","last_clean":"2024-09-16T07:39:58.013708+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:58.013708+0000","last_undegraded":"2024-09-16T07:39:58.013708+0000","last_fullsized":"2024-09-16T07:39:58.013708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'160","reported_seq":172,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.591810+0000","last_change":"2024-09-16T07:39:57.123748+0000","last_active":"2024-09-16T07:40:13.591810+0000","last_peered":"2024-09-16T07:40:13.591810+0000","last_clean":"2024-09-16T07:40:13.591810+0000","last_became_active":"2024-09-16T07:39:57.106298+0000","last_became_peered":"2024-09-16T07:39:57.106298+0000","last_unstale":"2024-09-16T07:40:13.591810+0000","last_undegraded":"2024-09-16T07:40:13.591810+0000","last_fullsized":"2024-09-16T07:40:13.591810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.012836+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:58.012836+0000","last_peered":"2024-09-16T07:39:58.012836+0000","last_clean":"2024-09-16T07:39:58.012836+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:58.012836+0000","last_undegraded":"2024-09-16T07:39:58.012836+0000","last_fullsized":"2024-09-16T07:39:58.012836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":24592384,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3002,"num_write_kb":24016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36876288,"data_stored":73752576,"data_compressed":3804939,"data_compressed_allocated":36876288,"data_compressed_original":73752576,"omap_allocated":0,"internal_metadata":0},"log_size":3002,"ondisk_log_size":3002,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44224,"kb_used_data":9068,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327616,"statfs":{"total":96636764160,"available":96591478784,"internally_reserved":0,"allocated":9285632,"data_stored":18318443,"data_compressed":942855,"data_compressed_allocated":9138176,"data_compressed_original":18276352,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43348,"kb_used_data":8196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94328492,"statfs":{"total":96636764160,"available":96592375808,"internally_reserved":0,"allocated":8392704,"data_stored":17000075,"data_compressed":874507,"data_compressed_allocated":8224768,"data_compressed_original":16941056,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44496,"kb_used_data":9340,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327344,"statfs":{"total":96636764160,"available":96591200256,"internally_reserved":0,"allocated":9564160,"data_stored":19342987,"data_compressed":995219,"data_compressed_allocated":9396224,"data_compressed_original":19283968,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44736,"kb_used_data":9584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9814016,"data_stored":19850872,"data_compressed":1021557,"data_compressed_allocated":9650176,"data_compressed_original":19791872,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9609216,"data_stored":19218432,"data_compressed":991520,"data_compressed_allocated":9609216,"data_compressed_original":19218432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9895936,"data_stored":19791872,"data_compressed":1021018,"data_compressed_allocated":9895936,"data_compressed_original":19791872,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8200192,"data_stored":16400384,"data_compressed":846162,"data_compressed_allocated":8200192,"data_compressed_original":16400384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9170944,"data_stored":18341888,"data_compressed":946239,"data_compressed_allocated":9170944,"data_compressed_original":18341888,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:40:36.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:36.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:36.993+0000 7f73436bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:36.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:37.000+0000 7f73436bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:37.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 39 16 6770 6754 1.35285 1.07812 0.0434014 0.0922838 2024-09-16T07:40:38.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:40:38.085561+0000 min lat: 0.0185115 max lat: 0.278092 avg lat: 0.0924964 2024-09-16T07:40:38.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:40:38.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 40 16 6926 6910 1.34949 1.21875 0.142595 0.0924964 2024-09-16T07:40:39.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 41 16 7083 7067 1.34649 1.22656 0.130137 0.0927125 2024-09-16T07:40:39.460 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:39.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:39.590+0000 7f078cad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:39.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:39.596+0000 7f078cad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:40.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 42 16 7229 7213 1.34159 1.14062 0.11645 0.0929962 2024-09-16T07:40:41.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 43 16 7407 7391 1.34272 1.39062 0.165377 0.0929711 2024-09-16T07:40:41.129 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:41.130 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:41.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:40:41.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:41.275+0000 7f8866e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:41.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:41.286+0000 7f8866e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:41.626 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:40:41.627 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:40:41.645 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-16T07:40:39.706563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25182771,"num_objects":380,"num_object_clones":0,"num_object_copies":1140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3083,"num_write_kb":25124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3057,"ondisk_log_size":3057,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":176804,"kb_used_data":36188,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377310556,"statfs":{"total":386547056640,"available":386366009344,"internally_reserved":0,"allocated":37056512,"data_stored":74512377,"data_compressed":3834138,"data_compressed_allocated":36409344,"data_compressed_original":74293248,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002355"},"pg_stats":[{"pgid":"3.f","version":"17'232","reported_seq":244,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.298240+0000","last_change":"2024-09-16T07:39:57.153006+0000","last_active":"2024-09-16T07:40:14.298240+0000","last_peered":"2024-09-16T07:40:14.298240+0000","last_clean":"2024-09-16T07:40:14.298240+0000","last_became_active":"2024-09-16T07:39:57.142405+0000","last_became_peered":"2024-09-16T07:39:57.142405+0000","last_unstale":"2024-09-16T07:40:14.298240+0000","last_undegraded":"2024-09-16T07:40:14.298240+0000","last_fullsized":"2024-09-16T07:40:14.298240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'186","reported_seq":198,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.739932+0000","last_change":"2024-09-16T07:39:57.210052+0000","last_active":"2024-09-16T07:40:14.739932+0000","last_peered":"2024-09-16T07:40:14.739932+0000","last_clean":"2024-09-16T07:40:14.739932+0000","last_became_active":"2024-09-16T07:39:57.203399+0000","last_became_peered":"2024-09-16T07:39:57.203399+0000","last_unstale":"2024-09-16T07:40:14.739932+0000","last_undegraded":"2024-09-16T07:40:14.739932+0000","last_fullsized":"2024-09-16T07:40:14.739932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1523712,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":1488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'120","reported_seq":132,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.426774+0000","last_change":"2024-09-16T07:39:57.124065+0000","last_active":"2024-09-16T07:40:14.426774+0000","last_peered":"2024-09-16T07:40:14.426774+0000","last_clean":"2024-09-16T07:40:14.426774+0000","last_became_active":"2024-09-16T07:39:57.114008+0000","last_became_peered":"2024-09-16T07:39:57.114008+0000","last_unstale":"2024-09-16T07:40:14.426774+0000","last_undegraded":"2024-09-16T07:40:14.426774+0000","last_fullsized":"2024-09-16T07:40:14.426774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"17'224","reported_seq":236,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.408522+0000","last_change":"2024-09-16T07:39:57.138304+0000","last_active":"2024-09-16T07:40:14.408522+0000","last_peered":"2024-09-16T07:40:14.408522+0000","last_clean":"2024-09-16T07:40:14.408522+0000","last_became_active":"2024-09-16T07:39:57.131604+0000","last_became_peered":"2024-09-16T07:39:57.131604+0000","last_unstale":"2024-09-16T07:40:14.408522+0000","last_undegraded":"2024-09-16T07:40:14.408522+0000","last_fullsized":"2024-09-16T07:40:14.408522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"17'192","reported_seq":204,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.199090+0000","last_change":"2024-09-16T07:39:57.223458+0000","last_active":"2024-09-16T07:40:14.199090+0000","last_peered":"2024-09-16T07:40:14.199090+0000","last_clean":"2024-09-16T07:40:14.199090+0000","last_became_active":"2024-09-16T07:39:57.216826+0000","last_became_peered":"2024-09-16T07:39:57.216826+0000","last_unstale":"2024-09-16T07:40:14.199090+0000","last_undegraded":"2024-09-16T07:40:14.199090+0000","last_fullsized":"2024-09-16T07:40:14.199090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1572864,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"17'208","reported_seq":220,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.741757+0000","last_change":"2024-09-16T07:39:57.146386+0000","last_active":"2024-09-16T07:40:14.741757+0000","last_peered":"2024-09-16T07:40:14.741757+0000","last_clean":"2024-09-16T07:40:14.741757+0000","last_became_active":"2024-09-16T07:39:57.140054+0000","last_became_peered":"2024-09-16T07:39:57.140054+0000","last_unstale":"2024-09-16T07:40:14.741757+0000","last_undegraded":"2024-09-16T07:40:14.741757+0000","last_fullsized":"2024-09-16T07:40:14.741757+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"17'264","reported_seq":276,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:12.737143+0000","last_change":"2024-09-16T07:39:57.170896+0000","last_active":"2024-09-16T07:40:12.737143+0000","last_peered":"2024-09-16T07:40:12.737143+0000","last_clean":"2024-09-16T07:40:12.737143+0000","last_became_active":"2024-09-16T07:39:57.162445+0000","last_became_peered":"2024-09-16T07:39:57.162445+0000","last_unstale":"2024-09-16T07:40:12.737143+0000","last_undegraded":"2024-09-16T07:40:12.737143+0000","last_fullsized":"2024-09-16T07:40:12.737143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"17'160","reported_seq":172,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.095614+0000","last_change":"2024-09-16T07:39:57.113233+0000","last_active":"2024-09-16T07:40:14.095614+0000","last_peered":"2024-09-16T07:40:14.095614+0000","last_clean":"2024-09-16T07:40:14.095614+0000","last_became_active":"2024-09-16T07:39:57.103200+0000","last_became_peered":"2024-09-16T07:39:57.103200+0000","last_unstale":"2024-09-16T07:40:14.095614+0000","last_undegraded":"2024-09-16T07:40:14.095614+0000","last_fullsized":"2024-09-16T07:40:14.095614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":94,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.010575+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:58.010575+0000","last_peered":"2024-09-16T07:39:58.010575+0000","last_clean":"2024-09-16T07:39:58.010575+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:58.010575+0000","last_undegraded":"2024-09-16T07:39:58.010575+0000","last_fullsized":"2024-09-16T07:39:58.010575+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016917+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:58.016917+0000","last_peered":"2024-09-16T07:39:58.016917+0000","last_clean":"2024-09-16T07:39:58.016917+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:58.016917+0000","last_undegraded":"2024-09-16T07:39:58.016917+0000","last_fullsized":"2024-09-16T07:39:58.016917+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'184","reported_seq":196,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:12.553297+0000","last_change":"2024-09-16T07:39:57.156383+0000","last_active":"2024-09-16T07:40:12.553297+0000","last_peered":"2024-09-16T07:40:12.553297+0000","last_clean":"2024-09-16T07:40:12.553297+0000","last_became_active":"2024-09-16T07:39:57.147931+0000","last_became_peered":"2024-09-16T07:39:57.147931+0000","last_unstale":"2024-09-16T07:40:12.553297+0000","last_undegraded":"2024-09-16T07:40:12.553297+0000","last_fullsized":"2024-09-16T07:40:12.553297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.011429+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:58.011429+0000","last_peered":"2024-09-16T07:39:58.011429+0000","last_clean":"2024-09-16T07:39:58.011429+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:58.011429+0000","last_undegraded":"2024-09-16T07:39:58.011429+0000","last_fullsized":"2024-09-16T07:39:58.011429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"17'216","reported_seq":228,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.557365+0000","last_change":"2024-09-16T07:39:57.167637+0000","last_active":"2024-09-16T07:40:14.557365+0000","last_peered":"2024-09-16T07:40:14.557365+0000","last_clean":"2024-09-16T07:40:14.557365+0000","last_became_active":"2024-09-16T07:39:57.153421+0000","last_became_peered":"2024-09-16T07:39:57.153421+0000","last_unstale":"2024-09-16T07:40:14.557365+0000","last_undegraded":"2024-09-16T07:40:14.557365+0000","last_fullsized":"2024-09-16T07:40:14.557365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.015132+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:58.015132+0000","last_peered":"2024-09-16T07:39:58.015132+0000","last_clean":"2024-09-16T07:39:58.015132+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:58.015132+0000","last_undegraded":"2024-09-16T07:39:58.015132+0000","last_fullsized":"2024-09-16T07:39:58.015132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'232","reported_seq":244,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.368945+0000","last_change":"2024-09-16T07:39:57.140655+0000","last_active":"2024-09-16T07:40:14.368945+0000","last_peered":"2024-09-16T07:40:14.368945+0000","last_clean":"2024-09-16T07:40:14.368945+0000","last_became_active":"2024-09-16T07:39:57.125541+0000","last_became_peered":"2024-09-16T07:39:57.125541+0000","last_unstale":"2024-09-16T07:40:14.368945+0000","last_undegraded":"2024-09-16T07:40:14.368945+0000","last_fullsized":"2024-09-16T07:40:14.368945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.018441+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:58.018441+0000","last_peered":"2024-09-16T07:39:58.018441+0000","last_clean":"2024-09-16T07:39:58.018441+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:58.018441+0000","last_undegraded":"2024-09-16T07:39:58.018441+0000","last_fullsized":"2024-09-16T07:39:58.018441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"17'184","reported_seq":196,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.855876+0000","last_change":"2024-09-16T07:39:57.131217+0000","last_active":"2024-09-16T07:40:13.855876+0000","last_peered":"2024-09-16T07:40:13.855876+0000","last_clean":"2024-09-16T07:40:13.855876+0000","last_became_active":"2024-09-16T07:39:57.119292+0000","last_became_peered":"2024-09-16T07:39:57.119292+0000","last_unstale":"2024-09-16T07:40:13.855876+0000","last_undegraded":"2024-09-16T07:40:13.855876+0000","last_fullsized":"2024-09-16T07:40:13.855876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"17'136","reported_seq":148,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.674709+0000","last_change":"2024-09-16T07:39:57.114512+0000","last_active":"2024-09-16T07:40:14.674709+0000","last_peered":"2024-09-16T07:40:14.674709+0000","last_clean":"2024-09-16T07:40:14.674709+0000","last_became_active":"2024-09-16T07:39:57.106844+0000","last_became_peered":"2024-09-16T07:39:57.106844+0000","last_unstale":"2024-09-16T07:40:14.674709+0000","last_undegraded":"2024-09-16T07:40:14.674709+0000","last_fullsized":"2024-09-16T07:40:14.674709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.020986+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:58.020986+0000","last_peered":"2024-09-16T07:39:58.020986+0000","last_clean":"2024-09-16T07:39:58.020986+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:58.020986+0000","last_undegraded":"2024-09-16T07:39:58.020986+0000","last_fullsized":"2024-09-16T07:39:58.020986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"17'152","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.319022+0000","last_change":"2024-09-16T07:39:57.152651+0000","last_active":"2024-09-16T07:40:13.319022+0000","last_peered":"2024-09-16T07:40:13.319022+0000","last_clean":"2024-09-16T07:40:13.319022+0000","last_became_active":"2024-09-16T07:39:57.141965+0000","last_became_peered":"2024-09-16T07:39:57.141965+0000","last_unstale":"2024-09-16T07:40:13.319022+0000","last_undegraded":"2024-09-16T07:40:13.319022+0000","last_fullsized":"2024-09-16T07:40:13.319022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016791+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:58.016791+0000","last_peered":"2024-09-16T07:39:58.016791+0000","last_clean":"2024-09-16T07:39:58.016791+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:58.016791+0000","last_undegraded":"2024-09-16T07:39:58.016791+0000","last_fullsized":"2024-09-16T07:39:58.016791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'152","reported_seq":164,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:14.707012+0000","last_change":"2024-09-16T07:39:57.200290+0000","last_active":"2024-09-16T07:40:14.707012+0000","last_peered":"2024-09-16T07:40:14.707012+0000","last_clean":"2024-09-16T07:40:14.707012+0000","last_became_active":"2024-09-16T07:39:57.189506+0000","last_became_peered":"2024-09-16T07:39:57.189506+0000","last_unstale":"2024-09-16T07:40:14.707012+0000","last_undegraded":"2024-09-16T07:40:14.707012+0000","last_fullsized":"2024-09-16T07:40:14.707012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.013708+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:58.013708+0000","last_peered":"2024-09-16T07:39:58.013708+0000","last_clean":"2024-09-16T07:39:58.013708+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:58.013708+0000","last_undegraded":"2024-09-16T07:39:58.013708+0000","last_fullsized":"2024-09-16T07:39:58.013708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'160","reported_seq":172,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:13.591810+0000","last_change":"2024-09-16T07:39:57.123748+0000","last_active":"2024-09-16T07:40:13.591810+0000","last_peered":"2024-09-16T07:40:13.591810+0000","last_clean":"2024-09-16T07:40:13.591810+0000","last_became_active":"2024-09-16T07:39:57.106298+0000","last_became_peered":"2024-09-16T07:39:57.106298+0000","last_unstale":"2024-09-16T07:40:13.591810+0000","last_undegraded":"2024-09-16T07:40:13.591810+0000","last_fullsized":"2024-09-16T07:40:13.591810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.012836+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:58.012836+0000","last_peered":"2024-09-16T07:39:58.012836+0000","last_clean":"2024-09-16T07:39:58.012836+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:58.012836+0000","last_undegraded":"2024-09-16T07:39:58.012836+0000","last_fullsized":"2024-09-16T07:39:58.012836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":24592384,"num_objects":376,"num_object_clones":0,"num_object_copies":1128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3002,"num_write_kb":24016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36876288,"data_stored":73752576,"data_compressed":3804939,"data_compressed_allocated":36876288,"data_compressed_original":73752576,"omap_allocated":0,"internal_metadata":0},"log_size":3002,"ondisk_log_size":3002,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44224,"kb_used_data":9068,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327616,"statfs":{"total":96636764160,"available":96591478784,"internally_reserved":0,"allocated":9285632,"data_stored":18318443,"data_compressed":942855,"data_compressed_allocated":9138176,"data_compressed_original":18276352,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43348,"kb_used_data":8196,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94328492,"statfs":{"total":96636764160,"available":96592375808,"internally_reserved":0,"allocated":8392704,"data_stored":17000075,"data_compressed":874507,"data_compressed_allocated":8224768,"data_compressed_original":16941056,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44496,"kb_used_data":9340,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327344,"statfs":{"total":96636764160,"available":96591200256,"internally_reserved":0,"allocated":9564160,"data_stored":19342987,"data_compressed":995219,"data_compressed_allocated":9396224,"data_compressed_original":19283968,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":44736,"kb_used_data":9584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9814016,"data_stored":19850872,"data_compressed":1021557,"data_compressed_allocated":9650176,"data_compressed_original":19791872,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9609216,"data_stored":19218432,"data_compressed":991520,"data_compressed_allocated":9609216,"data_compressed_original":19218432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9895936,"data_stored":19791872,"data_compressed":1021018,"data_compressed_allocated":9895936,"data_compressed_original":19791872,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8200192,"data_stored":16400384,"data_compressed":846162,"data_compressed_allocated":8200192,"data_compressed_original":16400384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9170944,"data_stored":18341888,"data_compressed":946239,"data_compressed_allocated":9170944,"data_compressed_original":18341888,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:40:41.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:41.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:41.925+0000 7fb3c0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:41.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:41.931+0000 7fb3c0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:42.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 44 16 7563 7547 1.3399 1.21875 0.154023 0.0931603 2024-09-16T07:40:43.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 45 16 7719 7703 1.33721 1.21875 0.230073 0.0932804 2024-09-16T07:40:44.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 46 16 7878 7862 1.33514 1.24219 0.0836945 0.0935286 2024-09-16T07:40:44.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:44.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:44.317+0000 7fdd81063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:44.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:44.325+0000 7fdd81063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:45.084 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 47 16 8027 8011 1.3315 1.16406 0.0737869 0.0937856 2024-09-16T07:40:46.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 48 16 8187 8171 1.3298 1.25 0.110432 0.0937948 2024-09-16T07:40:46.646 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:46.725 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:46.725 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:40:46.725 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:40:46.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:46.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:46.858+0000 7f3c6f8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:46.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:46.874+0000 7f3c6f8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:46.914 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:46.914 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:46.914 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:46.915 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:46.918 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:46.918 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:46.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:40:47.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:47.010+0000 7f12c0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:47.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:47.018+0000 7f12c0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:47.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 49 16 8346 8330 1.32801 1.24219 0.120663 0.0939619 2024-09-16T07:40:47.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:47.099+0000 7f6e0326c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:47.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:47.112+0000 7f6e0326c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:47.130 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:47.133 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:47.134 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:47.134 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:40:47.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:47.265+0000 7f5817791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:47.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:47.279+0000 7f5817791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:47.325 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:47.326 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:47.329 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:47.330 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:47.330 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:40:47.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:47.521+0000 7f8ed3aec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:47.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:47.534+0000 7f8ed3aec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:40:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:40:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:40:47.686 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:40:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:40:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:40:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:40:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:40:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:40:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:40:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:40:47.687 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:40:47.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:40:47.690 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:40:48.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 50 16 8499 8483 1.32535 1.19531 0.0466302 0.0942335 2024-09-16T07:40:49.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 51 16 8668 8652 1.32525 1.32031 0.0474477 0.0941952 2024-09-16T07:40:49.245 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:49.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:49.373+0000 7f28e6a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:49.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:49.380+0000 7f28e6a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:50.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 52 16 8819 8803 1.32245 1.17969 0.128053 0.0943974 2024-09-16T07:40:51.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 53 16 8979 8963 1.32108 1.25 0.147775 0.0945424 2024-09-16T07:40:51.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:51.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:51.790+0000 7f3595b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:51.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:51.798+0000 7f3595b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:52.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 54 16 9119 9103 1.31687 1.09375 0.0956195 0.0948108 2024-09-16T07:40:52.691 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:40:52.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:40:52.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:52.841+0000 7fb9b8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:52.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:52.859+0000 7fb9b8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:53.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 55 16 9280 9264 1.31579 1.25781 0.105345 0.0949195 2024-09-16T07:40:53.760 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:40:53.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:40:53.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:53.918+0000 7f8417b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:53.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:53.940+0000 7f8417b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:54.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 56 16 9443 9427 1.31503 1.27344 0.0825494 0.094976 2024-09-16T07:40:54.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:54.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:54.298+0000 7fab0f751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:54.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:54.308+0000 7fab0f751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:54.771 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:40:54.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:40:54.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:54.938+0000 7fdc90d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:54.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:54.953+0000 7fdc90d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:55.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 57 16 9599 9583 1.31334 1.21875 0.0665956 0.0950844 2024-09-16T07:40:55.776 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:40:55.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:40:55.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:55.941+0000 7f755f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:55.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:55.961+0000 7f755f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:56.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 58 16 9750 9734 1.31104 1.17969 0.13333 0.0952717 2024-09-16T07:40:56.536 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:40:56.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:56.678+0000 7f65b52e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:56.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:56.685+0000 7f65b52e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:56.782 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:40:56.799 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:40:56.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:40:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:56.927+0000 7fe1f1e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:56.943+0000 7fe1f0be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:57.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 59 16 9896 9880 1.30815 1.14062 0.0350128 0.0954623 2024-09-16T07:40:57.215 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:40:57.216 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:40:57.231 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-16T07:40:56.783784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65905203,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8054,"num_write_kb":64892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8028,"ondisk_log_size":8028,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":226848,"kb_used_data":94560,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377260512,"statfs":{"total":386547056640,"available":386314764288,"internally_reserved":0,"allocated":96829440,"data_stored":194058233,"data_compressed":10006977,"data_compressed_allocated":96182272,"data_compressed_original":193839104,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.074866"},"pg_stats":[{"pgid":"3.f","version":"17'592","reported_seq":604,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.963773+0000","last_change":"2024-09-16T07:39:57.153006+0000","last_active":"2024-09-16T07:40:43.963773+0000","last_peered":"2024-09-16T07:40:43.963773+0000","last_clean":"2024-09-16T07:40:43.963773+0000","last_became_active":"2024-09-16T07:39:57.142405+0000","last_became_peered":"2024-09-16T07:39:57.142405+0000","last_unstale":"2024-09-16T07:40:43.963773+0000","last_undegraded":"2024-09-16T07:40:43.963773+0000","last_fullsized":"2024-09-16T07:40:43.963773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'472","reported_seq":484,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.612053+0000","last_change":"2024-09-16T07:39:57.210052+0000","last_active":"2024-09-16T07:40:44.612053+0000","last_peered":"2024-09-16T07:40:44.612053+0000","last_clean":"2024-09-16T07:40:44.612053+0000","last_became_active":"2024-09-16T07:39:57.203399+0000","last_became_peered":"2024-09-16T07:39:57.203399+0000","last_unstale":"2024-09-16T07:40:44.612053+0000","last_undegraded":"2024-09-16T07:40:44.612053+0000","last_fullsized":"2024-09-16T07:40:44.612053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'344","reported_seq":356,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.725067+0000","last_change":"2024-09-16T07:39:57.124065+0000","last_active":"2024-09-16T07:40:44.725067+0000","last_peered":"2024-09-16T07:40:44.725067+0000","last_clean":"2024-09-16T07:40:44.725067+0000","last_became_active":"2024-09-16T07:39:57.114008+0000","last_became_peered":"2024-09-16T07:39:57.114008+0000","last_unstale":"2024-09-16T07:40:44.725067+0000","last_undegraded":"2024-09-16T07:40:44.725067+0000","last_fullsized":"2024-09-16T07:40:44.725067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"17'616","reported_seq":628,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.366045+0000","last_change":"2024-09-16T07:39:57.138304+0000","last_active":"2024-09-16T07:40:44.366045+0000","last_peered":"2024-09-16T07:40:44.366045+0000","last_clean":"2024-09-16T07:40:44.366045+0000","last_became_active":"2024-09-16T07:39:57.131604+0000","last_became_peered":"2024-09-16T07:39:57.131604+0000","last_unstale":"2024-09-16T07:40:44.366045+0000","last_undegraded":"2024-09-16T07:40:44.366045+0000","last_fullsized":"2024-09-16T07:40:44.366045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"17'408","reported_seq":420,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.805277+0000","last_change":"2024-09-16T07:39:57.223458+0000","last_active":"2024-09-16T07:40:43.805277+0000","last_peered":"2024-09-16T07:40:43.805277+0000","last_clean":"2024-09-16T07:40:43.805277+0000","last_became_active":"2024-09-16T07:39:57.216826+0000","last_became_peered":"2024-09-16T07:39:57.216826+0000","last_unstale":"2024-09-16T07:40:43.805277+0000","last_undegraded":"2024-09-16T07:40:43.805277+0000","last_fullsized":"2024-09-16T07:40:43.805277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"17'544","reported_seq":556,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.669204+0000","last_change":"2024-09-16T07:39:57.146386+0000","last_active":"2024-09-16T07:40:44.669204+0000","last_peered":"2024-09-16T07:40:44.669204+0000","last_clean":"2024-09-16T07:40:44.669204+0000","last_became_active":"2024-09-16T07:39:57.140054+0000","last_became_peered":"2024-09-16T07:39:57.140054+0000","last_unstale":"2024-09-16T07:40:44.669204+0000","last_undegraded":"2024-09-16T07:40:44.669204+0000","last_fullsized":"2024-09-16T07:40:44.669204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"17'576","reported_seq":588,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.195322+0000","last_change":"2024-09-16T07:39:57.170896+0000","last_active":"2024-09-16T07:40:44.195322+0000","last_peered":"2024-09-16T07:40:44.195322+0000","last_clean":"2024-09-16T07:40:44.195322+0000","last_became_active":"2024-09-16T07:39:57.162445+0000","last_became_peered":"2024-09-16T07:39:57.162445+0000","last_unstale":"2024-09-16T07:40:44.195322+0000","last_undegraded":"2024-09-16T07:40:44.195322+0000","last_fullsized":"2024-09-16T07:40:44.195322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"17'464","reported_seq":476,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.600412+0000","last_change":"2024-09-16T07:39:57.113233+0000","last_active":"2024-09-16T07:40:44.600412+0000","last_peered":"2024-09-16T07:40:44.600412+0000","last_clean":"2024-09-16T07:40:44.600412+0000","last_became_active":"2024-09-16T07:39:57.103200+0000","last_became_peered":"2024-09-16T07:39:57.103200+0000","last_unstale":"2024-09-16T07:40:44.600412+0000","last_undegraded":"2024-09-16T07:40:44.600412+0000","last_fullsized":"2024-09-16T07:40:44.600412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":94,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.010575+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:58.010575+0000","last_peered":"2024-09-16T07:39:58.010575+0000","last_clean":"2024-09-16T07:39:58.010575+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:58.010575+0000","last_undegraded":"2024-09-16T07:39:58.010575+0000","last_fullsized":"2024-09-16T07:39:58.010575+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016917+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:58.016917+0000","last_peered":"2024-09-16T07:39:58.016917+0000","last_clean":"2024-09-16T07:39:58.016917+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:58.016917+0000","last_undegraded":"2024-09-16T07:39:58.016917+0000","last_fullsized":"2024-09-16T07:39:58.016917+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'496","reported_seq":508,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.279709+0000","last_change":"2024-09-16T07:39:57.156383+0000","last_active":"2024-09-16T07:40:44.279709+0000","last_peered":"2024-09-16T07:40:44.279709+0000","last_clean":"2024-09-16T07:40:44.279709+0000","last_became_active":"2024-09-16T07:39:57.147931+0000","last_became_peered":"2024-09-16T07:39:57.147931+0000","last_unstale":"2024-09-16T07:40:44.279709+0000","last_undegraded":"2024-09-16T07:40:44.279709+0000","last_fullsized":"2024-09-16T07:40:44.279709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.011429+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:58.011429+0000","last_peered":"2024-09-16T07:39:58.011429+0000","last_clean":"2024-09-16T07:39:58.011429+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:58.011429+0000","last_undegraded":"2024-09-16T07:39:58.011429+0000","last_fullsized":"2024-09-16T07:39:58.011429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"17'549","reported_seq":561,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.755888+0000","last_change":"2024-09-16T07:39:57.167637+0000","last_active":"2024-09-16T07:40:44.755888+0000","last_peered":"2024-09-16T07:40:44.755888+0000","last_clean":"2024-09-16T07:40:44.755888+0000","last_became_active":"2024-09-16T07:39:57.153421+0000","last_became_peered":"2024-09-16T07:39:57.153421+0000","last_unstale":"2024-09-16T07:40:44.755888+0000","last_undegraded":"2024-09-16T07:40:44.755888+0000","last_fullsized":"2024-09-16T07:40:44.755888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.015132+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:58.015132+0000","last_peered":"2024-09-16T07:39:58.015132+0000","last_clean":"2024-09-16T07:39:58.015132+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:58.015132+0000","last_undegraded":"2024-09-16T07:39:58.015132+0000","last_fullsized":"2024-09-16T07:39:58.015132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'568","reported_seq":580,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.361274+0000","last_change":"2024-09-16T07:39:57.140655+0000","last_active":"2024-09-16T07:40:44.361274+0000","last_peered":"2024-09-16T07:40:44.361274+0000","last_clean":"2024-09-16T07:40:44.361274+0000","last_became_active":"2024-09-16T07:39:57.125541+0000","last_became_peered":"2024-09-16T07:39:57.125541+0000","last_unstale":"2024-09-16T07:40:44.361274+0000","last_undegraded":"2024-09-16T07:40:44.361274+0000","last_fullsized":"2024-09-16T07:40:44.361274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.018441+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:58.018441+0000","last_peered":"2024-09-16T07:39:58.018441+0000","last_clean":"2024-09-16T07:39:58.018441+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:58.018441+0000","last_undegraded":"2024-09-16T07:39:58.018441+0000","last_fullsized":"2024-09-16T07:39:58.018441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"17'512","reported_seq":524,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.632356+0000","last_change":"2024-09-16T07:39:57.131217+0000","last_active":"2024-09-16T07:40:43.632356+0000","last_peered":"2024-09-16T07:40:43.632356+0000","last_clean":"2024-09-16T07:40:43.632356+0000","last_became_active":"2024-09-16T07:39:57.119292+0000","last_became_peered":"2024-09-16T07:39:57.119292+0000","last_unstale":"2024-09-16T07:40:43.632356+0000","last_undegraded":"2024-09-16T07:40:43.632356+0000","last_fullsized":"2024-09-16T07:40:43.632356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"17'416","reported_seq":428,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.775424+0000","last_change":"2024-09-16T07:39:57.114512+0000","last_active":"2024-09-16T07:40:43.775424+0000","last_peered":"2024-09-16T07:40:43.775424+0000","last_clean":"2024-09-16T07:40:43.775424+0000","last_became_active":"2024-09-16T07:39:57.106844+0000","last_became_peered":"2024-09-16T07:39:57.106844+0000","last_unstale":"2024-09-16T07:40:43.775424+0000","last_undegraded":"2024-09-16T07:40:43.775424+0000","last_fullsized":"2024-09-16T07:40:43.775424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.020986+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:58.020986+0000","last_peered":"2024-09-16T07:39:58.020986+0000","last_clean":"2024-09-16T07:39:58.020986+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:58.020986+0000","last_undegraded":"2024-09-16T07:39:58.020986+0000","last_fullsized":"2024-09-16T07:39:58.020986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"17'432","reported_seq":444,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.650081+0000","last_change":"2024-09-16T07:39:57.152651+0000","last_active":"2024-09-16T07:40:43.650081+0000","last_peered":"2024-09-16T07:40:43.650081+0000","last_clean":"2024-09-16T07:40:43.650081+0000","last_became_active":"2024-09-16T07:39:57.141965+0000","last_became_peered":"2024-09-16T07:39:57.141965+0000","last_unstale":"2024-09-16T07:40:43.650081+0000","last_undegraded":"2024-09-16T07:40:43.650081+0000","last_fullsized":"2024-09-16T07:40:43.650081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016791+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:58.016791+0000","last_peered":"2024-09-16T07:39:58.016791+0000","last_clean":"2024-09-16T07:39:58.016791+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:58.016791+0000","last_undegraded":"2024-09-16T07:39:58.016791+0000","last_fullsized":"2024-09-16T07:39:58.016791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'432","reported_seq":444,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.397927+0000","last_change":"2024-09-16T07:39:57.200290+0000","last_active":"2024-09-16T07:40:43.397927+0000","last_peered":"2024-09-16T07:40:43.397927+0000","last_clean":"2024-09-16T07:40:43.397927+0000","last_became_active":"2024-09-16T07:39:57.189506+0000","last_became_peered":"2024-09-16T07:39:57.189506+0000","last_unstale":"2024-09-16T07:40:43.397927+0000","last_undegraded":"2024-09-16T07:40:43.397927+0000","last_fullsized":"2024-09-16T07:40:43.397927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.013708+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:58.013708+0000","last_peered":"2024-09-16T07:39:58.013708+0000","last_clean":"2024-09-16T07:39:58.013708+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:58.013708+0000","last_undegraded":"2024-09-16T07:39:58.013708+0000","last_fullsized":"2024-09-16T07:39:58.013708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'552","reported_seq":564,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.467121+0000","last_change":"2024-09-16T07:39:57.123748+0000","last_active":"2024-09-16T07:40:44.467121+0000","last_peered":"2024-09-16T07:40:44.467121+0000","last_clean":"2024-09-16T07:40:44.467121+0000","last_became_active":"2024-09-16T07:39:57.106298+0000","last_became_peered":"2024-09-16T07:39:57.106298+0000","last_unstale":"2024-09-16T07:40:44.467121+0000","last_undegraded":"2024-09-16T07:40:44.467121+0000","last_fullsized":"2024-09-16T07:40:44.467121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.012836+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:58.012836+0000","last_peered":"2024-09-16T07:39:58.012836+0000","last_clean":"2024-09-16T07:39:58.012836+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:58.012836+0000","last_undegraded":"2024-09-16T07:39:58.012836+0000","last_fullsized":"2024-09-16T07:39:58.012836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":65314816,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7973,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97955840,"data_stored":195911680,"data_compressed":10112715,"data_compressed_allocated":97955840,"data_compressed_original":195911680,"omap_allocated":0,"internal_metadata":0},"log_size":7973,"ondisk_log_size":7973,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54168,"kb_used_data":23176,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317672,"statfs":{"total":96636764160,"available":96581296128,"internally_reserved":0,"allocated":23732224,"data_stored":47211627,"data_compressed":2434776,"data_compressed_allocated":23584768,"data_compressed_original":47169536,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51900,"kb_used_data":20908,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319940,"statfs":{"total":96636764160,"available":96583618560,"internally_reserved":0,"allocated":21409792,"data_stored":43034251,"data_compressed":2218801,"data_compressed_allocated":21241856,"data_compressed_original":42975232,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60464,"kb_used_data":25312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311376,"statfs":{"total":96636764160,"available":96574849024,"internally_reserved":0,"allocated":25919488,"data_stored":52053643,"data_compressed":2684258,"data_compressed_allocated":25751552,"data_compressed_original":51994624,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60316,"kb_used_data":25164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311524,"statfs":{"total":96636764160,"available":96575000576,"internally_reserved":0,"allocated":25767936,"data_stored":51758712,"data_compressed":2669142,"data_compressed_allocated":25604096,"data_compressed_original":51699712,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26038272,"data_stored":52076544,"data_compressed":2688173,"data_compressed_allocated":26038272,"data_compressed_original":52076544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26275840,"data_stored":52551680,"data_compressed":2712595,"data_compressed_allocated":26275840,"data_compressed_original":52551680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21610496,"data_stored":43220992,"data_compressed":2231064,"data_compressed_allocated":21610496,"data_compressed_original":43220992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24031232,"data_stored":48062464,"data_compressed":2480883,"data_compressed_allocated":24031232,"data_compressed_original":48062464,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:40:57.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:40:57.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:57.362+0000 7fdc88551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:57.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:57.371+0000 7fdc88551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:57.681 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:40:57.682 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:40:57.700 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-16T07:40:56.783784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65905203,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8054,"num_write_kb":64892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8028,"ondisk_log_size":8028,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":226848,"kb_used_data":94560,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377260512,"statfs":{"total":386547056640,"available":386314764288,"internally_reserved":0,"allocated":96829440,"data_stored":194058233,"data_compressed":10006977,"data_compressed_allocated":96182272,"data_compressed_original":193839104,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.074866"},"pg_stats":[{"pgid":"3.f","version":"17'592","reported_seq":604,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.963773+0000","last_change":"2024-09-16T07:39:57.153006+0000","last_active":"2024-09-16T07:40:43.963773+0000","last_peered":"2024-09-16T07:40:43.963773+0000","last_clean":"2024-09-16T07:40:43.963773+0000","last_became_active":"2024-09-16T07:39:57.142405+0000","last_became_peered":"2024-09-16T07:39:57.142405+0000","last_unstale":"2024-09-16T07:40:43.963773+0000","last_undegraded":"2024-09-16T07:40:43.963773+0000","last_fullsized":"2024-09-16T07:40:43.963773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'472","reported_seq":484,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.612053+0000","last_change":"2024-09-16T07:39:57.210052+0000","last_active":"2024-09-16T07:40:44.612053+0000","last_peered":"2024-09-16T07:40:44.612053+0000","last_clean":"2024-09-16T07:40:44.612053+0000","last_became_active":"2024-09-16T07:39:57.203399+0000","last_became_peered":"2024-09-16T07:39:57.203399+0000","last_unstale":"2024-09-16T07:40:44.612053+0000","last_undegraded":"2024-09-16T07:40:44.612053+0000","last_fullsized":"2024-09-16T07:40:44.612053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'344","reported_seq":356,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.725067+0000","last_change":"2024-09-16T07:39:57.124065+0000","last_active":"2024-09-16T07:40:44.725067+0000","last_peered":"2024-09-16T07:40:44.725067+0000","last_clean":"2024-09-16T07:40:44.725067+0000","last_became_active":"2024-09-16T07:39:57.114008+0000","last_became_peered":"2024-09-16T07:39:57.114008+0000","last_unstale":"2024-09-16T07:40:44.725067+0000","last_undegraded":"2024-09-16T07:40:44.725067+0000","last_fullsized":"2024-09-16T07:40:44.725067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"17'616","reported_seq":628,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.366045+0000","last_change":"2024-09-16T07:39:57.138304+0000","last_active":"2024-09-16T07:40:44.366045+0000","last_peered":"2024-09-16T07:40:44.366045+0000","last_clean":"2024-09-16T07:40:44.366045+0000","last_became_active":"2024-09-16T07:39:57.131604+0000","last_became_peered":"2024-09-16T07:39:57.131604+0000","last_unstale":"2024-09-16T07:40:44.366045+0000","last_undegraded":"2024-09-16T07:40:44.366045+0000","last_fullsized":"2024-09-16T07:40:44.366045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"17'408","reported_seq":420,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.805277+0000","last_change":"2024-09-16T07:39:57.223458+0000","last_active":"2024-09-16T07:40:43.805277+0000","last_peered":"2024-09-16T07:40:43.805277+0000","last_clean":"2024-09-16T07:40:43.805277+0000","last_became_active":"2024-09-16T07:39:57.216826+0000","last_became_peered":"2024-09-16T07:39:57.216826+0000","last_unstale":"2024-09-16T07:40:43.805277+0000","last_undegraded":"2024-09-16T07:40:43.805277+0000","last_fullsized":"2024-09-16T07:40:43.805277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"17'544","reported_seq":556,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.669204+0000","last_change":"2024-09-16T07:39:57.146386+0000","last_active":"2024-09-16T07:40:44.669204+0000","last_peered":"2024-09-16T07:40:44.669204+0000","last_clean":"2024-09-16T07:40:44.669204+0000","last_became_active":"2024-09-16T07:39:57.140054+0000","last_became_peered":"2024-09-16T07:39:57.140054+0000","last_unstale":"2024-09-16T07:40:44.669204+0000","last_undegraded":"2024-09-16T07:40:44.669204+0000","last_fullsized":"2024-09-16T07:40:44.669204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"17'576","reported_seq":588,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.195322+0000","last_change":"2024-09-16T07:39:57.170896+0000","last_active":"2024-09-16T07:40:44.195322+0000","last_peered":"2024-09-16T07:40:44.195322+0000","last_clean":"2024-09-16T07:40:44.195322+0000","last_became_active":"2024-09-16T07:39:57.162445+0000","last_became_peered":"2024-09-16T07:39:57.162445+0000","last_unstale":"2024-09-16T07:40:44.195322+0000","last_undegraded":"2024-09-16T07:40:44.195322+0000","last_fullsized":"2024-09-16T07:40:44.195322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"17'464","reported_seq":476,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.600412+0000","last_change":"2024-09-16T07:39:57.113233+0000","last_active":"2024-09-16T07:40:44.600412+0000","last_peered":"2024-09-16T07:40:44.600412+0000","last_clean":"2024-09-16T07:40:44.600412+0000","last_became_active":"2024-09-16T07:39:57.103200+0000","last_became_peered":"2024-09-16T07:39:57.103200+0000","last_unstale":"2024-09-16T07:40:44.600412+0000","last_undegraded":"2024-09-16T07:40:44.600412+0000","last_fullsized":"2024-09-16T07:40:44.600412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":94,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.010575+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:58.010575+0000","last_peered":"2024-09-16T07:39:58.010575+0000","last_clean":"2024-09-16T07:39:58.010575+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:58.010575+0000","last_undegraded":"2024-09-16T07:39:58.010575+0000","last_fullsized":"2024-09-16T07:39:58.010575+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016917+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:58.016917+0000","last_peered":"2024-09-16T07:39:58.016917+0000","last_clean":"2024-09-16T07:39:58.016917+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:58.016917+0000","last_undegraded":"2024-09-16T07:39:58.016917+0000","last_fullsized":"2024-09-16T07:39:58.016917+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'496","reported_seq":508,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.279709+0000","last_change":"2024-09-16T07:39:57.156383+0000","last_active":"2024-09-16T07:40:44.279709+0000","last_peered":"2024-09-16T07:40:44.279709+0000","last_clean":"2024-09-16T07:40:44.279709+0000","last_became_active":"2024-09-16T07:39:57.147931+0000","last_became_peered":"2024-09-16T07:39:57.147931+0000","last_unstale":"2024-09-16T07:40:44.279709+0000","last_undegraded":"2024-09-16T07:40:44.279709+0000","last_fullsized":"2024-09-16T07:40:44.279709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.011429+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:58.011429+0000","last_peered":"2024-09-16T07:39:58.011429+0000","last_clean":"2024-09-16T07:39:58.011429+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:58.011429+0000","last_undegraded":"2024-09-16T07:39:58.011429+0000","last_fullsized":"2024-09-16T07:39:58.011429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"17'549","reported_seq":561,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.755888+0000","last_change":"2024-09-16T07:39:57.167637+0000","last_active":"2024-09-16T07:40:44.755888+0000","last_peered":"2024-09-16T07:40:44.755888+0000","last_clean":"2024-09-16T07:40:44.755888+0000","last_became_active":"2024-09-16T07:39:57.153421+0000","last_became_peered":"2024-09-16T07:39:57.153421+0000","last_unstale":"2024-09-16T07:40:44.755888+0000","last_undegraded":"2024-09-16T07:40:44.755888+0000","last_fullsized":"2024-09-16T07:40:44.755888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.015132+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:58.015132+0000","last_peered":"2024-09-16T07:39:58.015132+0000","last_clean":"2024-09-16T07:39:58.015132+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:58.015132+0000","last_undegraded":"2024-09-16T07:39:58.015132+0000","last_fullsized":"2024-09-16T07:39:58.015132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'568","reported_seq":580,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.361274+0000","last_change":"2024-09-16T07:39:57.140655+0000","last_active":"2024-09-16T07:40:44.361274+0000","last_peered":"2024-09-16T07:40:44.361274+0000","last_clean":"2024-09-16T07:40:44.361274+0000","last_became_active":"2024-09-16T07:39:57.125541+0000","last_became_peered":"2024-09-16T07:39:57.125541+0000","last_unstale":"2024-09-16T07:40:44.361274+0000","last_undegraded":"2024-09-16T07:40:44.361274+0000","last_fullsized":"2024-09-16T07:40:44.361274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.018441+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:58.018441+0000","last_peered":"2024-09-16T07:39:58.018441+0000","last_clean":"2024-09-16T07:39:58.018441+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:58.018441+0000","last_undegraded":"2024-09-16T07:39:58.018441+0000","last_fullsized":"2024-09-16T07:39:58.018441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"17'512","reported_seq":524,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.632356+0000","last_change":"2024-09-16T07:39:57.131217+0000","last_active":"2024-09-16T07:40:43.632356+0000","last_peered":"2024-09-16T07:40:43.632356+0000","last_clean":"2024-09-16T07:40:43.632356+0000","last_became_active":"2024-09-16T07:39:57.119292+0000","last_became_peered":"2024-09-16T07:39:57.119292+0000","last_unstale":"2024-09-16T07:40:43.632356+0000","last_undegraded":"2024-09-16T07:40:43.632356+0000","last_fullsized":"2024-09-16T07:40:43.632356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"17'416","reported_seq":428,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.775424+0000","last_change":"2024-09-16T07:39:57.114512+0000","last_active":"2024-09-16T07:40:43.775424+0000","last_peered":"2024-09-16T07:40:43.775424+0000","last_clean":"2024-09-16T07:40:43.775424+0000","last_became_active":"2024-09-16T07:39:57.106844+0000","last_became_peered":"2024-09-16T07:39:57.106844+0000","last_unstale":"2024-09-16T07:40:43.775424+0000","last_undegraded":"2024-09-16T07:40:43.775424+0000","last_fullsized":"2024-09-16T07:40:43.775424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.020986+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:58.020986+0000","last_peered":"2024-09-16T07:39:58.020986+0000","last_clean":"2024-09-16T07:39:58.020986+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:58.020986+0000","last_undegraded":"2024-09-16T07:39:58.020986+0000","last_fullsized":"2024-09-16T07:39:58.020986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"17'432","reported_seq":444,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.650081+0000","last_change":"2024-09-16T07:39:57.152651+0000","last_active":"2024-09-16T07:40:43.650081+0000","last_peered":"2024-09-16T07:40:43.650081+0000","last_clean":"2024-09-16T07:40:43.650081+0000","last_became_active":"2024-09-16T07:39:57.141965+0000","last_became_peered":"2024-09-16T07:39:57.141965+0000","last_unstale":"2024-09-16T07:40:43.650081+0000","last_undegraded":"2024-09-16T07:40:43.650081+0000","last_fullsized":"2024-09-16T07:40:43.650081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016791+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:58.016791+0000","last_peered":"2024-09-16T07:39:58.016791+0000","last_clean":"2024-09-16T07:39:58.016791+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:58.016791+0000","last_undegraded":"2024-09-16T07:39:58.016791+0000","last_fullsized":"2024-09-16T07:39:58.016791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'432","reported_seq":444,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.397927+0000","last_change":"2024-09-16T07:39:57.200290+0000","last_active":"2024-09-16T07:40:43.397927+0000","last_peered":"2024-09-16T07:40:43.397927+0000","last_clean":"2024-09-16T07:40:43.397927+0000","last_became_active":"2024-09-16T07:39:57.189506+0000","last_became_peered":"2024-09-16T07:39:57.189506+0000","last_unstale":"2024-09-16T07:40:43.397927+0000","last_undegraded":"2024-09-16T07:40:43.397927+0000","last_fullsized":"2024-09-16T07:40:43.397927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.013708+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:58.013708+0000","last_peered":"2024-09-16T07:39:58.013708+0000","last_clean":"2024-09-16T07:39:58.013708+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:58.013708+0000","last_undegraded":"2024-09-16T07:39:58.013708+0000","last_fullsized":"2024-09-16T07:39:58.013708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'552","reported_seq":564,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.467121+0000","last_change":"2024-09-16T07:39:57.123748+0000","last_active":"2024-09-16T07:40:44.467121+0000","last_peered":"2024-09-16T07:40:44.467121+0000","last_clean":"2024-09-16T07:40:44.467121+0000","last_became_active":"2024-09-16T07:39:57.106298+0000","last_became_peered":"2024-09-16T07:39:57.106298+0000","last_unstale":"2024-09-16T07:40:44.467121+0000","last_undegraded":"2024-09-16T07:40:44.467121+0000","last_fullsized":"2024-09-16T07:40:44.467121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.012836+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:58.012836+0000","last_peered":"2024-09-16T07:39:58.012836+0000","last_clean":"2024-09-16T07:39:58.012836+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:58.012836+0000","last_undegraded":"2024-09-16T07:39:58.012836+0000","last_fullsized":"2024-09-16T07:39:58.012836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":65314816,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7973,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97955840,"data_stored":195911680,"data_compressed":10112715,"data_compressed_allocated":97955840,"data_compressed_original":195911680,"omap_allocated":0,"internal_metadata":0},"log_size":7973,"ondisk_log_size":7973,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54168,"kb_used_data":23176,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317672,"statfs":{"total":96636764160,"available":96581296128,"internally_reserved":0,"allocated":23732224,"data_stored":47211627,"data_compressed":2434776,"data_compressed_allocated":23584768,"data_compressed_original":47169536,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51900,"kb_used_data":20908,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319940,"statfs":{"total":96636764160,"available":96583618560,"internally_reserved":0,"allocated":21409792,"data_stored":43034251,"data_compressed":2218801,"data_compressed_allocated":21241856,"data_compressed_original":42975232,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60464,"kb_used_data":25312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311376,"statfs":{"total":96636764160,"available":96574849024,"internally_reserved":0,"allocated":25919488,"data_stored":52053643,"data_compressed":2684258,"data_compressed_allocated":25751552,"data_compressed_original":51994624,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60316,"kb_used_data":25164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311524,"statfs":{"total":96636764160,"available":96575000576,"internally_reserved":0,"allocated":25767936,"data_stored":51758712,"data_compressed":2669142,"data_compressed_allocated":25604096,"data_compressed_original":51699712,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26038272,"data_stored":52076544,"data_compressed":2688173,"data_compressed_allocated":26038272,"data_compressed_original":52076544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26275840,"data_stored":52551680,"data_compressed":2712595,"data_compressed_allocated":26275840,"data_compressed_original":52551680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21610496,"data_stored":43220992,"data_compressed":2231064,"data_compressed_allocated":21610496,"data_compressed_original":43220992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24031232,"data_stored":48062464,"data_compressed":2480883,"data_compressed_allocated":24031232,"data_compressed_original":48062464,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:40:57.701 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:40:57.701 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:40:57.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:40:57.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:57.825+0000 7f67a0111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:57.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:57.835+0000 7f67a0111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:58.077 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:40:58.077 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:40:58.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:40:58.087357+0000 min lat: 0.0185115 max lat: 0.300316 avg lat: 0.095693 2024-09-16T07:40:58.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:40:58.085 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 60 16 10040 10024 1.30509 1.125 0.082074 0.095693 2024-09-16T07:40:58.096 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-16T07:40:57.709977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65905203,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8054,"num_write_kb":64892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8028,"ondisk_log_size":8028,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":226848,"kb_used_data":94560,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377260512,"statfs":{"total":386547056640,"available":386314764288,"internally_reserved":0,"allocated":96829440,"data_stored":194058233,"data_compressed":10006977,"data_compressed_allocated":96182272,"data_compressed_original":193839104,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000693"},"pg_stats":[{"pgid":"3.f","version":"17'592","reported_seq":604,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.963773+0000","last_change":"2024-09-16T07:39:57.153006+0000","last_active":"2024-09-16T07:40:43.963773+0000","last_peered":"2024-09-16T07:40:43.963773+0000","last_clean":"2024-09-16T07:40:43.963773+0000","last_became_active":"2024-09-16T07:39:57.142405+0000","last_became_peered":"2024-09-16T07:39:57.142405+0000","last_unstale":"2024-09-16T07:40:43.963773+0000","last_undegraded":"2024-09-16T07:40:43.963773+0000","last_fullsized":"2024-09-16T07:40:43.963773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'472","reported_seq":484,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.612053+0000","last_change":"2024-09-16T07:39:57.210052+0000","last_active":"2024-09-16T07:40:44.612053+0000","last_peered":"2024-09-16T07:40:44.612053+0000","last_clean":"2024-09-16T07:40:44.612053+0000","last_became_active":"2024-09-16T07:39:57.203399+0000","last_became_peered":"2024-09-16T07:39:57.203399+0000","last_unstale":"2024-09-16T07:40:44.612053+0000","last_undegraded":"2024-09-16T07:40:44.612053+0000","last_fullsized":"2024-09-16T07:40:44.612053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'344","reported_seq":356,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.725067+0000","last_change":"2024-09-16T07:39:57.124065+0000","last_active":"2024-09-16T07:40:44.725067+0000","last_peered":"2024-09-16T07:40:44.725067+0000","last_clean":"2024-09-16T07:40:44.725067+0000","last_became_active":"2024-09-16T07:39:57.114008+0000","last_became_peered":"2024-09-16T07:39:57.114008+0000","last_unstale":"2024-09-16T07:40:44.725067+0000","last_undegraded":"2024-09-16T07:40:44.725067+0000","last_fullsized":"2024-09-16T07:40:44.725067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"17'616","reported_seq":628,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.366045+0000","last_change":"2024-09-16T07:39:57.138304+0000","last_active":"2024-09-16T07:40:44.366045+0000","last_peered":"2024-09-16T07:40:44.366045+0000","last_clean":"2024-09-16T07:40:44.366045+0000","last_became_active":"2024-09-16T07:39:57.131604+0000","last_became_peered":"2024-09-16T07:39:57.131604+0000","last_unstale":"2024-09-16T07:40:44.366045+0000","last_undegraded":"2024-09-16T07:40:44.366045+0000","last_fullsized":"2024-09-16T07:40:44.366045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"17'408","reported_seq":420,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.805277+0000","last_change":"2024-09-16T07:39:57.223458+0000","last_active":"2024-09-16T07:40:43.805277+0000","last_peered":"2024-09-16T07:40:43.805277+0000","last_clean":"2024-09-16T07:40:43.805277+0000","last_became_active":"2024-09-16T07:39:57.216826+0000","last_became_peered":"2024-09-16T07:39:57.216826+0000","last_unstale":"2024-09-16T07:40:43.805277+0000","last_undegraded":"2024-09-16T07:40:43.805277+0000","last_fullsized":"2024-09-16T07:40:43.805277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"17'544","reported_seq":556,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.669204+0000","last_change":"2024-09-16T07:39:57.146386+0000","last_active":"2024-09-16T07:40:44.669204+0000","last_peered":"2024-09-16T07:40:44.669204+0000","last_clean":"2024-09-16T07:40:44.669204+0000","last_became_active":"2024-09-16T07:39:57.140054+0000","last_became_peered":"2024-09-16T07:39:57.140054+0000","last_unstale":"2024-09-16T07:40:44.669204+0000","last_undegraded":"2024-09-16T07:40:44.669204+0000","last_fullsized":"2024-09-16T07:40:44.669204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"17'576","reported_seq":588,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.195322+0000","last_change":"2024-09-16T07:39:57.170896+0000","last_active":"2024-09-16T07:40:44.195322+0000","last_peered":"2024-09-16T07:40:44.195322+0000","last_clean":"2024-09-16T07:40:44.195322+0000","last_became_active":"2024-09-16T07:39:57.162445+0000","last_became_peered":"2024-09-16T07:39:57.162445+0000","last_unstale":"2024-09-16T07:40:44.195322+0000","last_undegraded":"2024-09-16T07:40:44.195322+0000","last_fullsized":"2024-09-16T07:40:44.195322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"17'464","reported_seq":476,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.600412+0000","last_change":"2024-09-16T07:39:57.113233+0000","last_active":"2024-09-16T07:40:44.600412+0000","last_peered":"2024-09-16T07:40:44.600412+0000","last_clean":"2024-09-16T07:40:44.600412+0000","last_became_active":"2024-09-16T07:39:57.103200+0000","last_became_peered":"2024-09-16T07:39:57.103200+0000","last_unstale":"2024-09-16T07:40:44.600412+0000","last_undegraded":"2024-09-16T07:40:44.600412+0000","last_fullsized":"2024-09-16T07:40:44.600412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":94,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.010575+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:58.010575+0000","last_peered":"2024-09-16T07:39:58.010575+0000","last_clean":"2024-09-16T07:39:58.010575+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:58.010575+0000","last_undegraded":"2024-09-16T07:39:58.010575+0000","last_fullsized":"2024-09-16T07:39:58.010575+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016917+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:58.016917+0000","last_peered":"2024-09-16T07:39:58.016917+0000","last_clean":"2024-09-16T07:39:58.016917+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:58.016917+0000","last_undegraded":"2024-09-16T07:39:58.016917+0000","last_fullsized":"2024-09-16T07:39:58.016917+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'496","reported_seq":508,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.279709+0000","last_change":"2024-09-16T07:39:57.156383+0000","last_active":"2024-09-16T07:40:44.279709+0000","last_peered":"2024-09-16T07:40:44.279709+0000","last_clean":"2024-09-16T07:40:44.279709+0000","last_became_active":"2024-09-16T07:39:57.147931+0000","last_became_peered":"2024-09-16T07:39:57.147931+0000","last_unstale":"2024-09-16T07:40:44.279709+0000","last_undegraded":"2024-09-16T07:40:44.279709+0000","last_fullsized":"2024-09-16T07:40:44.279709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.011429+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:58.011429+0000","last_peered":"2024-09-16T07:39:58.011429+0000","last_clean":"2024-09-16T07:39:58.011429+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:58.011429+0000","last_undegraded":"2024-09-16T07:39:58.011429+0000","last_fullsized":"2024-09-16T07:39:58.011429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"17'549","reported_seq":561,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.755888+0000","last_change":"2024-09-16T07:39:57.167637+0000","last_active":"2024-09-16T07:40:44.755888+0000","last_peered":"2024-09-16T07:40:44.755888+0000","last_clean":"2024-09-16T07:40:44.755888+0000","last_became_active":"2024-09-16T07:39:57.153421+0000","last_became_peered":"2024-09-16T07:39:57.153421+0000","last_unstale":"2024-09-16T07:40:44.755888+0000","last_undegraded":"2024-09-16T07:40:44.755888+0000","last_fullsized":"2024-09-16T07:40:44.755888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.015132+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:58.015132+0000","last_peered":"2024-09-16T07:39:58.015132+0000","last_clean":"2024-09-16T07:39:58.015132+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:58.015132+0000","last_undegraded":"2024-09-16T07:39:58.015132+0000","last_fullsized":"2024-09-16T07:39:58.015132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'568","reported_seq":580,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.361274+0000","last_change":"2024-09-16T07:39:57.140655+0000","last_active":"2024-09-16T07:40:44.361274+0000","last_peered":"2024-09-16T07:40:44.361274+0000","last_clean":"2024-09-16T07:40:44.361274+0000","last_became_active":"2024-09-16T07:39:57.125541+0000","last_became_peered":"2024-09-16T07:39:57.125541+0000","last_unstale":"2024-09-16T07:40:44.361274+0000","last_undegraded":"2024-09-16T07:40:44.361274+0000","last_fullsized":"2024-09-16T07:40:44.361274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.018441+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:58.018441+0000","last_peered":"2024-09-16T07:39:58.018441+0000","last_clean":"2024-09-16T07:39:58.018441+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:58.018441+0000","last_undegraded":"2024-09-16T07:39:58.018441+0000","last_fullsized":"2024-09-16T07:39:58.018441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"17'512","reported_seq":524,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.632356+0000","last_change":"2024-09-16T07:39:57.131217+0000","last_active":"2024-09-16T07:40:43.632356+0000","last_peered":"2024-09-16T07:40:43.632356+0000","last_clean":"2024-09-16T07:40:43.632356+0000","last_became_active":"2024-09-16T07:39:57.119292+0000","last_became_peered":"2024-09-16T07:39:57.119292+0000","last_unstale":"2024-09-16T07:40:43.632356+0000","last_undegraded":"2024-09-16T07:40:43.632356+0000","last_fullsized":"2024-09-16T07:40:43.632356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"17'416","reported_seq":428,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.775424+0000","last_change":"2024-09-16T07:39:57.114512+0000","last_active":"2024-09-16T07:40:43.775424+0000","last_peered":"2024-09-16T07:40:43.775424+0000","last_clean":"2024-09-16T07:40:43.775424+0000","last_became_active":"2024-09-16T07:39:57.106844+0000","last_became_peered":"2024-09-16T07:39:57.106844+0000","last_unstale":"2024-09-16T07:40:43.775424+0000","last_undegraded":"2024-09-16T07:40:43.775424+0000","last_fullsized":"2024-09-16T07:40:43.775424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.020986+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:58.020986+0000","last_peered":"2024-09-16T07:39:58.020986+0000","last_clean":"2024-09-16T07:39:58.020986+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:58.020986+0000","last_undegraded":"2024-09-16T07:39:58.020986+0000","last_fullsized":"2024-09-16T07:39:58.020986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"17'432","reported_seq":444,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.650081+0000","last_change":"2024-09-16T07:39:57.152651+0000","last_active":"2024-09-16T07:40:43.650081+0000","last_peered":"2024-09-16T07:40:43.650081+0000","last_clean":"2024-09-16T07:40:43.650081+0000","last_became_active":"2024-09-16T07:39:57.141965+0000","last_became_peered":"2024-09-16T07:39:57.141965+0000","last_unstale":"2024-09-16T07:40:43.650081+0000","last_undegraded":"2024-09-16T07:40:43.650081+0000","last_fullsized":"2024-09-16T07:40:43.650081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016791+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:58.016791+0000","last_peered":"2024-09-16T07:39:58.016791+0000","last_clean":"2024-09-16T07:39:58.016791+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:58.016791+0000","last_undegraded":"2024-09-16T07:39:58.016791+0000","last_fullsized":"2024-09-16T07:39:58.016791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'432","reported_seq":444,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.397927+0000","last_change":"2024-09-16T07:39:57.200290+0000","last_active":"2024-09-16T07:40:43.397927+0000","last_peered":"2024-09-16T07:40:43.397927+0000","last_clean":"2024-09-16T07:40:43.397927+0000","last_became_active":"2024-09-16T07:39:57.189506+0000","last_became_peered":"2024-09-16T07:39:57.189506+0000","last_unstale":"2024-09-16T07:40:43.397927+0000","last_undegraded":"2024-09-16T07:40:43.397927+0000","last_fullsized":"2024-09-16T07:40:43.397927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.013708+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:58.013708+0000","last_peered":"2024-09-16T07:39:58.013708+0000","last_clean":"2024-09-16T07:39:58.013708+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:58.013708+0000","last_undegraded":"2024-09-16T07:39:58.013708+0000","last_fullsized":"2024-09-16T07:39:58.013708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'552","reported_seq":564,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.467121+0000","last_change":"2024-09-16T07:39:57.123748+0000","last_active":"2024-09-16T07:40:44.467121+0000","last_peered":"2024-09-16T07:40:44.467121+0000","last_clean":"2024-09-16T07:40:44.467121+0000","last_became_active":"2024-09-16T07:39:57.106298+0000","last_became_peered":"2024-09-16T07:39:57.106298+0000","last_unstale":"2024-09-16T07:40:44.467121+0000","last_undegraded":"2024-09-16T07:40:44.467121+0000","last_fullsized":"2024-09-16T07:40:44.467121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.012836+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:58.012836+0000","last_peered":"2024-09-16T07:39:58.012836+0000","last_clean":"2024-09-16T07:39:58.012836+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:58.012836+0000","last_undegraded":"2024-09-16T07:39:58.012836+0000","last_fullsized":"2024-09-16T07:39:58.012836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":65314816,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7973,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97955840,"data_stored":195911680,"data_compressed":10112715,"data_compressed_allocated":97955840,"data_compressed_original":195911680,"omap_allocated":0,"internal_metadata":0},"log_size":7973,"ondisk_log_size":7973,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54168,"kb_used_data":23176,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317672,"statfs":{"total":96636764160,"available":96581296128,"internally_reserved":0,"allocated":23732224,"data_stored":47211627,"data_compressed":2434776,"data_compressed_allocated":23584768,"data_compressed_original":47169536,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51900,"kb_used_data":20908,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319940,"statfs":{"total":96636764160,"available":96583618560,"internally_reserved":0,"allocated":21409792,"data_stored":43034251,"data_compressed":2218801,"data_compressed_allocated":21241856,"data_compressed_original":42975232,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60464,"kb_used_data":25312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311376,"statfs":{"total":96636764160,"available":96574849024,"internally_reserved":0,"allocated":25919488,"data_stored":52053643,"data_compressed":2684258,"data_compressed_allocated":25751552,"data_compressed_original":51994624,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60316,"kb_used_data":25164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311524,"statfs":{"total":96636764160,"available":96575000576,"internally_reserved":0,"allocated":25767936,"data_stored":51758712,"data_compressed":2669142,"data_compressed_allocated":25604096,"data_compressed_original":51699712,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26038272,"data_stored":52076544,"data_compressed":2688173,"data_compressed_allocated":26038272,"data_compressed_original":52076544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26275840,"data_stored":52551680,"data_compressed":2712595,"data_compressed_allocated":26275840,"data_compressed_original":52551680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21610496,"data_stored":43220992,"data_compressed":2231064,"data_compressed_allocated":21610496,"data_compressed_original":43220992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24031232,"data_stored":48062464,"data_compressed":2480883,"data_compressed_allocated":24031232,"data_compressed_original":48062464,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:40:58.999 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:40:59.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 61 16 10193 10177 1.30329 1.19531 0.0793673 0.0957889 2024-09-16T07:40:59.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:59.146+0000 7f1090991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:40:59.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:40:59.155+0000 7f1090991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:00.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 62 16 10355 10339 1.30268 1.26562 0.175965 0.0959099 2024-09-16T07:41:01.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 63 16 10497 10481 1.29961 1.10938 0.0798994 0.0960729 2024-09-16T07:41:01.593 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:01.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:01.716+0000 7f6e9af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:01.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:01.723+0000 7f6e9af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:02.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 64 16 10644 10628 1.29725 1.14844 0.0386803 0.0963055 2024-09-16T07:41:03.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 65 16 10801 10785 1.29616 1.22656 0.105913 0.0963487 2024-09-16T07:41:03.098 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:03.098 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:03.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:41:03.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:03.242+0000 7ff5bff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:03.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:03.254+0000 7ff5bff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:03.486 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:41:03.486 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:41:03.503 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-16T07:41:01.710762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":65905203,"num_objects":1001,"num_object_clones":0,"num_object_copies":3003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8054,"num_write_kb":64892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8028,"ondisk_log_size":8028,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":226848,"kb_used_data":94560,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377260512,"statfs":{"total":386547056640,"available":386314764288,"internally_reserved":0,"allocated":96829440,"data_stored":194058233,"data_compressed":10006977,"data_compressed_allocated":96182272,"data_compressed_original":193839104,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.937163"},"pg_stats":[{"pgid":"3.f","version":"17'592","reported_seq":604,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.963773+0000","last_change":"2024-09-16T07:39:57.153006+0000","last_active":"2024-09-16T07:40:43.963773+0000","last_peered":"2024-09-16T07:40:43.963773+0000","last_clean":"2024-09-16T07:40:43.963773+0000","last_became_active":"2024-09-16T07:39:57.142405+0000","last_became_peered":"2024-09-16T07:39:57.142405+0000","last_unstale":"2024-09-16T07:40:43.963773+0000","last_undegraded":"2024-09-16T07:40:43.963773+0000","last_fullsized":"2024-09-16T07:40:43.963773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'472","reported_seq":484,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.612053+0000","last_change":"2024-09-16T07:39:57.210052+0000","last_active":"2024-09-16T07:40:44.612053+0000","last_peered":"2024-09-16T07:40:44.612053+0000","last_clean":"2024-09-16T07:40:44.612053+0000","last_became_active":"2024-09-16T07:39:57.203399+0000","last_became_peered":"2024-09-16T07:39:57.203399+0000","last_unstale":"2024-09-16T07:40:44.612053+0000","last_undegraded":"2024-09-16T07:40:44.612053+0000","last_fullsized":"2024-09-16T07:40:44.612053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'344","reported_seq":356,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.725067+0000","last_change":"2024-09-16T07:39:57.124065+0000","last_active":"2024-09-16T07:40:44.725067+0000","last_peered":"2024-09-16T07:40:44.725067+0000","last_clean":"2024-09-16T07:40:44.725067+0000","last_became_active":"2024-09-16T07:39:57.114008+0000","last_became_peered":"2024-09-16T07:39:57.114008+0000","last_unstale":"2024-09-16T07:40:44.725067+0000","last_undegraded":"2024-09-16T07:40:44.725067+0000","last_fullsized":"2024-09-16T07:40:44.725067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"17'616","reported_seq":628,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.366045+0000","last_change":"2024-09-16T07:39:57.138304+0000","last_active":"2024-09-16T07:40:44.366045+0000","last_peered":"2024-09-16T07:40:44.366045+0000","last_clean":"2024-09-16T07:40:44.366045+0000","last_became_active":"2024-09-16T07:39:57.131604+0000","last_became_peered":"2024-09-16T07:39:57.131604+0000","last_unstale":"2024-09-16T07:40:44.366045+0000","last_undegraded":"2024-09-16T07:40:44.366045+0000","last_fullsized":"2024-09-16T07:40:44.366045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"17'408","reported_seq":420,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.805277+0000","last_change":"2024-09-16T07:39:57.223458+0000","last_active":"2024-09-16T07:40:43.805277+0000","last_peered":"2024-09-16T07:40:43.805277+0000","last_clean":"2024-09-16T07:40:43.805277+0000","last_became_active":"2024-09-16T07:39:57.216826+0000","last_became_peered":"2024-09-16T07:39:57.216826+0000","last_unstale":"2024-09-16T07:40:43.805277+0000","last_undegraded":"2024-09-16T07:40:43.805277+0000","last_fullsized":"2024-09-16T07:40:43.805277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"17'544","reported_seq":556,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.669204+0000","last_change":"2024-09-16T07:39:57.146386+0000","last_active":"2024-09-16T07:40:44.669204+0000","last_peered":"2024-09-16T07:40:44.669204+0000","last_clean":"2024-09-16T07:40:44.669204+0000","last_became_active":"2024-09-16T07:39:57.140054+0000","last_became_peered":"2024-09-16T07:39:57.140054+0000","last_unstale":"2024-09-16T07:40:44.669204+0000","last_undegraded":"2024-09-16T07:40:44.669204+0000","last_fullsized":"2024-09-16T07:40:44.669204+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"17'576","reported_seq":588,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.195322+0000","last_change":"2024-09-16T07:39:57.170896+0000","last_active":"2024-09-16T07:40:44.195322+0000","last_peered":"2024-09-16T07:40:44.195322+0000","last_clean":"2024-09-16T07:40:44.195322+0000","last_became_active":"2024-09-16T07:39:57.162445+0000","last_became_peered":"2024-09-16T07:39:57.162445+0000","last_unstale":"2024-09-16T07:40:44.195322+0000","last_undegraded":"2024-09-16T07:40:44.195322+0000","last_fullsized":"2024-09-16T07:40:44.195322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"17'464","reported_seq":476,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.600412+0000","last_change":"2024-09-16T07:39:57.113233+0000","last_active":"2024-09-16T07:40:44.600412+0000","last_peered":"2024-09-16T07:40:44.600412+0000","last_clean":"2024-09-16T07:40:44.600412+0000","last_became_active":"2024-09-16T07:39:57.103200+0000","last_became_peered":"2024-09-16T07:39:57.103200+0000","last_unstale":"2024-09-16T07:40:44.600412+0000","last_undegraded":"2024-09-16T07:40:44.600412+0000","last_fullsized":"2024-09-16T07:40:44.600412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":94,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.010575+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:39:58.010575+0000","last_peered":"2024-09-16T07:39:58.010575+0000","last_clean":"2024-09-16T07:39:58.010575+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:39:58.010575+0000","last_undegraded":"2024-09-16T07:39:58.010575+0000","last_fullsized":"2024-09-16T07:39:58.010575+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016917+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:39:58.016917+0000","last_peered":"2024-09-16T07:39:58.016917+0000","last_clean":"2024-09-16T07:39:58.016917+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:39:58.016917+0000","last_undegraded":"2024-09-16T07:39:58.016917+0000","last_fullsized":"2024-09-16T07:39:58.016917+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'496","reported_seq":508,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.279709+0000","last_change":"2024-09-16T07:39:57.156383+0000","last_active":"2024-09-16T07:40:44.279709+0000","last_peered":"2024-09-16T07:40:44.279709+0000","last_clean":"2024-09-16T07:40:44.279709+0000","last_became_active":"2024-09-16T07:39:57.147931+0000","last_became_peered":"2024-09-16T07:39:57.147931+0000","last_unstale":"2024-09-16T07:40:44.279709+0000","last_undegraded":"2024-09-16T07:40:44.279709+0000","last_fullsized":"2024-09-16T07:40:44.279709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.011429+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:39:58.011429+0000","last_peered":"2024-09-16T07:39:58.011429+0000","last_clean":"2024-09-16T07:39:58.011429+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:39:58.011429+0000","last_undegraded":"2024-09-16T07:39:58.011429+0000","last_fullsized":"2024-09-16T07:39:58.011429+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"17'549","reported_seq":561,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.755888+0000","last_change":"2024-09-16T07:39:57.167637+0000","last_active":"2024-09-16T07:40:44.755888+0000","last_peered":"2024-09-16T07:40:44.755888+0000","last_clean":"2024-09-16T07:40:44.755888+0000","last_became_active":"2024-09-16T07:39:57.153421+0000","last_became_peered":"2024-09-16T07:39:57.153421+0000","last_unstale":"2024-09-16T07:40:44.755888+0000","last_undegraded":"2024-09-16T07:40:44.755888+0000","last_fullsized":"2024-09-16T07:40:44.755888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4497408,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.015132+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:39:58.015132+0000","last_peered":"2024-09-16T07:39:58.015132+0000","last_clean":"2024-09-16T07:39:58.015132+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:39:58.015132+0000","last_undegraded":"2024-09-16T07:39:58.015132+0000","last_fullsized":"2024-09-16T07:39:58.015132+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'568","reported_seq":580,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.361274+0000","last_change":"2024-09-16T07:39:57.140655+0000","last_active":"2024-09-16T07:40:44.361274+0000","last_peered":"2024-09-16T07:40:44.361274+0000","last_clean":"2024-09-16T07:40:44.361274+0000","last_became_active":"2024-09-16T07:39:57.125541+0000","last_became_peered":"2024-09-16T07:39:57.125541+0000","last_unstale":"2024-09-16T07:40:44.361274+0000","last_undegraded":"2024-09-16T07:40:44.361274+0000","last_fullsized":"2024-09-16T07:40:44.361274+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.018441+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:39:58.018441+0000","last_peered":"2024-09-16T07:39:58.018441+0000","last_clean":"2024-09-16T07:39:58.018441+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:39:58.018441+0000","last_undegraded":"2024-09-16T07:39:58.018441+0000","last_fullsized":"2024-09-16T07:39:58.018441+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"17'512","reported_seq":524,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.632356+0000","last_change":"2024-09-16T07:39:57.131217+0000","last_active":"2024-09-16T07:40:43.632356+0000","last_peered":"2024-09-16T07:40:43.632356+0000","last_clean":"2024-09-16T07:40:43.632356+0000","last_became_active":"2024-09-16T07:39:57.119292+0000","last_became_peered":"2024-09-16T07:39:57.119292+0000","last_unstale":"2024-09-16T07:40:43.632356+0000","last_undegraded":"2024-09-16T07:40:43.632356+0000","last_fullsized":"2024-09-16T07:40:43.632356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"17'416","reported_seq":428,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.775424+0000","last_change":"2024-09-16T07:39:57.114512+0000","last_active":"2024-09-16T07:40:43.775424+0000","last_peered":"2024-09-16T07:40:43.775424+0000","last_clean":"2024-09-16T07:40:43.775424+0000","last_became_active":"2024-09-16T07:39:57.106844+0000","last_became_peered":"2024-09-16T07:39:57.106844+0000","last_unstale":"2024-09-16T07:40:43.775424+0000","last_undegraded":"2024-09-16T07:40:43.775424+0000","last_fullsized":"2024-09-16T07:40:43.775424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.020986+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:39:58.020986+0000","last_peered":"2024-09-16T07:39:58.020986+0000","last_clean":"2024-09-16T07:39:58.020986+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:39:58.020986+0000","last_undegraded":"2024-09-16T07:39:58.020986+0000","last_fullsized":"2024-09-16T07:39:58.020986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"17'432","reported_seq":444,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.650081+0000","last_change":"2024-09-16T07:39:57.152651+0000","last_active":"2024-09-16T07:40:43.650081+0000","last_peered":"2024-09-16T07:40:43.650081+0000","last_clean":"2024-09-16T07:40:43.650081+0000","last_became_active":"2024-09-16T07:39:57.141965+0000","last_became_peered":"2024-09-16T07:39:57.141965+0000","last_unstale":"2024-09-16T07:40:43.650081+0000","last_undegraded":"2024-09-16T07:40:43.650081+0000","last_fullsized":"2024-09-16T07:40:43.650081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.016791+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:39:58.016791+0000","last_peered":"2024-09-16T07:39:58.016791+0000","last_clean":"2024-09-16T07:39:58.016791+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:39:58.016791+0000","last_undegraded":"2024-09-16T07:39:58.016791+0000","last_fullsized":"2024-09-16T07:39:58.016791+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'432","reported_seq":444,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:43.397927+0000","last_change":"2024-09-16T07:39:57.200290+0000","last_active":"2024-09-16T07:40:43.397927+0000","last_peered":"2024-09-16T07:40:43.397927+0000","last_clean":"2024-09-16T07:40:43.397927+0000","last_became_active":"2024-09-16T07:39:57.189506+0000","last_became_peered":"2024-09-16T07:39:57.189506+0000","last_unstale":"2024-09-16T07:40:43.397927+0000","last_undegraded":"2024-09-16T07:40:43.397927+0000","last_fullsized":"2024-09-16T07:40:43.397927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.013708+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:39:58.013708+0000","last_peered":"2024-09-16T07:39:58.013708+0000","last_clean":"2024-09-16T07:39:58.013708+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:39:58.013708+0000","last_undegraded":"2024-09-16T07:39:58.013708+0000","last_fullsized":"2024-09-16T07:39:58.013708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"17'552","reported_seq":564,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:40:44.467121+0000","last_change":"2024-09-16T07:39:57.123748+0000","last_active":"2024-09-16T07:40:44.467121+0000","last_peered":"2024-09-16T07:40:44.467121+0000","last_clean":"2024-09-16T07:40:44.467121+0000","last_became_active":"2024-09-16T07:39:57.106298+0000","last_became_peered":"2024-09-16T07:39:57.106298+0000","last_unstale":"2024-09-16T07:40:44.467121+0000","last_undegraded":"2024-09-16T07:40:44.467121+0000","last_fullsized":"2024-09-16T07:40:44.467121+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-16T07:39:58.012836+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:39:58.012836+0000","last_peered":"2024-09-16T07:39:58.012836+0000","last_clean":"2024-09-16T07:39:58.012836+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:39:58.012836+0000","last_undegraded":"2024-09-16T07:39:58.012836+0000","last_fullsized":"2024-09-16T07:39:58.012836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":65314816,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7973,"num_write_kb":63784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97955840,"data_stored":195911680,"data_compressed":10112715,"data_compressed_allocated":97955840,"data_compressed_original":195911680,"omap_allocated":0,"internal_metadata":0},"log_size":7973,"ondisk_log_size":7973,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54168,"kb_used_data":23176,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317672,"statfs":{"total":96636764160,"available":96581296128,"internally_reserved":0,"allocated":23732224,"data_stored":47211627,"data_compressed":2434776,"data_compressed_allocated":23584768,"data_compressed_original":47169536,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51900,"kb_used_data":20908,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94319940,"statfs":{"total":96636764160,"available":96583618560,"internally_reserved":0,"allocated":21409792,"data_stored":43034251,"data_compressed":2218801,"data_compressed_allocated":21241856,"data_compressed_original":42975232,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60464,"kb_used_data":25312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311376,"statfs":{"total":96636764160,"available":96574849024,"internally_reserved":0,"allocated":25919488,"data_stored":52053643,"data_compressed":2684258,"data_compressed_allocated":25751552,"data_compressed_original":51994624,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60316,"kb_used_data":25164,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311524,"statfs":{"total":96636764160,"available":96575000576,"internally_reserved":0,"allocated":25767936,"data_stored":51758712,"data_compressed":2669142,"data_compressed_allocated":25604096,"data_compressed_original":51699712,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26038272,"data_stored":52076544,"data_compressed":2688173,"data_compressed_allocated":26038272,"data_compressed_original":52076544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26275840,"data_stored":52551680,"data_compressed":2712595,"data_compressed_allocated":26275840,"data_compressed_original":52551680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21610496,"data_stored":43220992,"data_compressed":2231064,"data_compressed_allocated":21610496,"data_compressed_original":43220992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24031232,"data_stored":48062464,"data_compressed":2480883,"data_compressed_allocated":24031232,"data_compressed_original":48062464,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:41:04.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:04.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 66 16 10956 10940 1.29487 1.21094 0.133934 0.0964446 2024-09-16T07:41:04.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:04.128+0000 7fb892af4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:04.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:04.136+0000 7fb892af4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:05.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 67 16 11105 11089 1.29291 1.16406 0.0947123 0.0965464 2024-09-16T07:41:06.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 68 16 11262 11246 1.29194 1.22656 0.0815832 0.0966967 2024-09-16T07:41:06.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:06.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:06.441+0000 7efc43f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:06.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:06.448+0000 7efc43f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:07.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 69 16 11414 11398 1.29042 1.1875 0.0700355 0.0967813 2024-09-16T07:41:08.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 70 16 11561 11545 1.28839 1.14844 0.0333039 0.0969396 2024-09-16T07:41:08.509 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:08.509 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:08.509 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:41:08.509 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:41:08.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:08.639+0000 7f5defa5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:08.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:08.655+0000 7f5defa5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:08.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:08.900 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:08.900 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:08.900 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:08.900 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:08.900 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:08.900 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:08.900 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:08.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:08.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:08.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:08.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:08.901 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:08.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:08.900+0000 7f7525311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:08.904 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:08.905 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:08.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:41:08.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:08.908+0000 7f7525311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:09.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:09.050+0000 7f799a0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:09.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:09.062+0000 7f799a0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:09.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 71 16 11725 11709 1.28829 1.28125 0.120948 0.0969424 2024-09-16T07:41:09.218 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:09.218 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:09.218 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:09.219 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:09.222 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:09.223 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:09.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:41:09.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:09.396+0000 7fc20e474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:09.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:09.408+0000 7fc20e474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:09.488 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:09.488 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:09.488 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:09.489 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:09.492 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:09.492 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:09.493 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:41:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:09.638+0000 7ff3e4d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:09.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:09.656+0000 7ff3e4d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:09.680 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:09.681 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:09.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:09.684 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:10.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 72 16 11875 11859 1.28667 1.17188 0.156851 0.0970384 2024-09-16T07:41:11.086 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 73 16 12025 12009 1.2851 1.17188 0.0907181 0.0971591 2024-09-16T07:41:11.221 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:11.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:11.366+0000 7f6c5cf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:11.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:11.372+0000 7f6c5cf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:12.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 74 16 12161 12145 1.28209 1.0625 0.110894 0.0974049 2024-09-16T07:41:13.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 75 16 12320 12304 1.28155 1.24219 0.127812 0.0974069 2024-09-16T07:41:13.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:13.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:13.698+0000 7fb165f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:13.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:13.705+0000 7fb165f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:14.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 76 16 12475 12459 1.28062 1.21094 0.0911697 0.0975206 2024-09-16T07:41:14.685 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:14.685 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:14.685 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:41:14.686 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:41:14.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:14.821+0000 7f162b6a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:14.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:14.834+0000 7f162b6a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:14.863 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:14.863 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:14.863 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:14.863 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:14.864 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:14.864 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:14.864 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:14.864 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:14.864 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:14.864 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:14.864 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:14.864 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:14.866 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:14.867 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:14.867 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:41:15.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:14.992+0000 7fcab9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:15.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:15.005+0000 7fcab9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:15.081 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:15.082 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:15.082 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:15.082 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:15.082 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:15.085 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:15.085 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:15.086 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:41:15.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 77 16 12618 12602 1.2785 1.11719 0.165742 0.0976583 2024-09-16T07:41:15.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:15.225+0000 7f69e1311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:15.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:15.237+0000 7f69e1311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:15.257 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:15.257 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:15.257 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:15.257 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:15.257 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:15.257 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:15.258 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:15.258 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:15.258 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:15.258 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:15.258 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:15.258 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:15.261 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:15.261 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:15.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:41:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:15.397+0000 7f936c2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:15.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:15.411+0000 7f936c2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:15.447 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:15.447 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:15.447 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:15.447 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:15.447 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:15.447 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:15.447 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:15.447 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:15.448 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:15.448 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:15.448 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:15.448 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:15.448 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:15.449 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:16.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 78 16 12765 12749 1.27683 1.14844 0.0758268 0.0978342 2024-09-16T07:41:16.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:16.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:16.310+0000 7f127e674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:16.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:16.317+0000 7f127e674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:17.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 79 16 12897 12881 1.27372 1.03125 0.160613 0.0980754 2024-09-16T07:41:18.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:41:18.089084+0000 min lat: 0.0185115 max lat: 0.300316 avg lat: 0.0980802 2024-09-16T07:41:18.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:41:18.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 80 16 13057 13041 1.27342 1.25 0.105854 0.0980802 2024-09-16T07:41:18.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:18.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:18.723+0000 7f4f1ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:18.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:18.731+0000 7f4f1ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:19.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 81 16 13217 13201 1.27313 1.25 0.0816593 0.0981286 2024-09-16T07:41:20.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 82 16 13358 13342 1.27104 1.10156 0.0979563 0.0982283 2024-09-16T07:41:20.450 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:20.450 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:20.450 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:41:20.450 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:41:20.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:20.609+0000 7f4bda391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:20.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:20.622+0000 7f4bda391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:20.712 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:20.715 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:20.715 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:20.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:41:20.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:20.880+0000 7f6c7cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:20.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:20.896+0000 7f6c7cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:20.968 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:20.971 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:20.971 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:20.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:41:21.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:21.087 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 83 16 13520 13504 1.27097 1.26562 0.156436 0.0982517 2024-09-16T07:41:21.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:21.123+0000 7f6f3c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:21.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:21.136+0000 7f6f3c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:21.206 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:21.207 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:21.210 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:21.210 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:21.211 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:41:21.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:21.234+0000 7f1233391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:21.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:21.246+0000 7f1233391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:21.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:21.407+0000 7f4b4e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:21.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:21.421+0000 7f4b4e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:21.491 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:21.492 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:21.495 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:21.495 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:22.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 84 16 13669 13653 1.2697 1.16406 0.191008 0.098313 2024-09-16T07:41:23.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 85 16 13817 13801 1.26836 1.15625 0.0822081 0.0984579 2024-09-16T07:41:23.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:23.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:23.732+0000 7f57be151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:23.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:23.742+0000 7f57be151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:24.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 86 16 13990 13974 1.26933 1.35156 0.0598854 0.0984362 2024-09-16T07:41:25.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 87 16 14136 14120 1.26785 1.14062 0.0522461 0.0985144 2024-09-16T07:41:26.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 88 16 14280 14264 1.26622 1.125 0.161738 0.0986493 2024-09-16T07:41:26.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:26.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:26.298+0000 7ff30ee63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:26.306+0000 7ff30ee63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:26.496 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:26.497 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:26.497 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:41:26.497 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:41:26.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:26.622+0000 7f32d8d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:26.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:26.634+0000 7f32d8d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:26.650 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:26.651 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:26.654 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:26.654 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:26.654 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:41:26.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:26.777+0000 7ff8ac191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:26.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:26.790+0000 7ff8ac191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:26.841 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:26.841 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:26.841 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:26.842 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:26.845 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:26.846 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:26.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:41:27.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:27.006+0000 7f8903511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:27.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:27.019+0000 7f8903511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:27.051 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:27.054 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:27.054 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:27.055 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:41:27.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 89 16 14413 14397 1.26367 1.03906 0.0945175 0.098835 2024-09-16T07:41:27.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:27.194+0000 7f91b9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:27.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:27.208+0000 7f91b9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:27.232 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:27.235 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:27.235 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:28.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 90 16 14552 14536 1.26169 1.08594 0.135207 0.0989869 2024-09-16T07:41:28.830 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:28.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:28.940+0000 7ff014391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:28.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:28.945+0000 7ff014391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:29.088 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total time run: 90.0923 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total writes made: 14552 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Write size: 8192 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object size: 65536 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Bandwidth (MB/sec): 1.2619 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Bandwidth: 0.122592 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max bandwidth (MB/sec): 1.53125 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min bandwidth (MB/sec): 1.02344 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average IOPS: 161 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev IOPS: 15.6917 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max IOPS: 196 2024-09-16T07:41:29.089 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min IOPS: 131 2024-09-16T07:41:29.090 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average Latency(s): 0.0990041 2024-09-16T07:41:29.090 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Latency(s): 0.0409294 2024-09-16T07:41:29.090 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max latency(s): 0.305941 2024-09-16T07:41:29.090 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min latency(s): 0.0185115 2024-09-16T07:41:29.123 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:41:31.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:31.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:31.210+0000 7f4f11191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:31.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:31.219+0000 7f4f11191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:32.237 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:32.237 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:32.237 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:41:32.237 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:41:32.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:32.379+0000 7fd18d86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:32.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:32.395+0000 7fd18d86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:32.436 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:32.436 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:32.436 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:32.436 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:32.436 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:32.436 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:32.436 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:32.436 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:32.437 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:32.437 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:32.437 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:32.437 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:32.439 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:32.440 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:32.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:41:32.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:32.590+0000 7f1d9d0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:32.602+0000 7f1d9d0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:32.725 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:32.726 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:32.726 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:32.726 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:32.729 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:32.729 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:32.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:41:32.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:32.887+0000 7f33d0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:32.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:32.903+0000 7f33d0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:32.987 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:32.987 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:32.987 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:32.988 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:32.991 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:32.991 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:32.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:41:33.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:33.153+0000 7ff239d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:33.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:33.167+0000 7ff239d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:33.223 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:33.225 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:33.226 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:33.592 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:33.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:33.732+0000 7f2ef9088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:33.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:33.741+0000 7f2ef9088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:36.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:36.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:36.441+0000 7f116b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:36.449+0000 7f116b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:38.227 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:38.227 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:38.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:41:38.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:38.382+0000 7f0753791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:38.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:38.393+0000 7f0753791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:38.693 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:41:38.694 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:41:38.712 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-16T07:41:37.717659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":103563827,"num_objects":1576,"num_object_clones":0,"num_object_copies":4728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":12651,"num_write_kb":101668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12625,"ondisk_log_size":12625,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":278180,"kb_used_data":150052,"kb_used_omap":0,"kb_used_meta":128064,"kb_avail":377209180,"statfs":{"total":386547056640,"available":386262200320,"internally_reserved":0,"allocated":153653248,"data_stored":307496073,"data_compressed":15861717,"data_compressed_allocated":152875008,"data_compressed_original":307224576,"omap_allocated":0,"internal_metadata":131137536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002247"},"pg_stats":[{"pgid":"3.f","version":"21'864","reported_seq":888,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.386302+0000","last_change":"2024-09-16T07:39:57.153006+0000","last_active":"2024-09-16T07:41:14.386302+0000","last_peered":"2024-09-16T07:41:14.386302+0000","last_clean":"2024-09-16T07:41:14.386302+0000","last_became_active":"2024-09-16T07:39:57.142405+0000","last_became_peered":"2024-09-16T07:39:57.142405+0000","last_unstale":"2024-09-16T07:41:14.386302+0000","last_undegraded":"2024-09-16T07:41:14.386302+0000","last_fullsized":"2024-09-16T07:41:14.386302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'688","reported_seq":712,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.436798+0000","last_change":"2024-09-16T07:39:57.210052+0000","last_active":"2024-09-16T07:41:14.436798+0000","last_peered":"2024-09-16T07:41:14.436798+0000","last_clean":"2024-09-16T07:41:14.436798+0000","last_became_active":"2024-09-16T07:39:57.203399+0000","last_became_peered":"2024-09-16T07:39:57.203399+0000","last_unstale":"2024-09-16T07:41:14.436798+0000","last_undegraded":"2024-09-16T07:41:14.436798+0000","last_fullsized":"2024-09-16T07:41:14.436798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"21'664","reported_seq":688,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:13.840080+0000","last_change":"2024-09-16T07:39:57.124065+0000","last_active":"2024-09-16T07:41:13.840080+0000","last_peered":"2024-09-16T07:41:13.840080+0000","last_clean":"2024-09-16T07:41:13.840080+0000","last_became_active":"2024-09-16T07:39:57.114008+0000","last_became_peered":"2024-09-16T07:39:57.114008+0000","last_unstale":"2024-09-16T07:41:13.840080+0000","last_undegraded":"2024-09-16T07:41:13.840080+0000","last_fullsized":"2024-09-16T07:41:13.840080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"21'904","reported_seq":928,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.510253+0000","last_change":"2024-09-16T07:39:57.138304+0000","last_active":"2024-09-16T07:41:14.510253+0000","last_peered":"2024-09-16T07:41:14.510253+0000","last_clean":"2024-09-16T07:41:14.510253+0000","last_became_active":"2024-09-16T07:39:57.131604+0000","last_became_peered":"2024-09-16T07:39:57.131604+0000","last_unstale":"2024-09-16T07:41:14.510253+0000","last_undegraded":"2024-09-16T07:41:14.510253+0000","last_fullsized":"2024-09-16T07:41:14.510253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"21'752","reported_seq":776,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.662104+0000","last_change":"2024-09-16T07:39:57.223458+0000","last_active":"2024-09-16T07:41:14.662104+0000","last_peered":"2024-09-16T07:41:14.662104+0000","last_clean":"2024-09-16T07:41:14.662104+0000","last_became_active":"2024-09-16T07:39:57.216826+0000","last_became_peered":"2024-09-16T07:39:57.216826+0000","last_unstale":"2024-09-16T07:41:14.662104+0000","last_undegraded":"2024-09-16T07:41:14.662104+0000","last_fullsized":"2024-09-16T07:41:14.662104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"21'864","reported_seq":888,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.534064+0000","last_change":"2024-09-16T07:39:57.146386+0000","last_active":"2024-09-16T07:41:14.534064+0000","last_peered":"2024-09-16T07:41:14.534064+0000","last_clean":"2024-09-16T07:41:14.534064+0000","last_became_active":"2024-09-16T07:39:57.140054+0000","last_became_peered":"2024-09-16T07:39:57.140054+0000","last_unstale":"2024-09-16T07:41:14.534064+0000","last_undegraded":"2024-09-16T07:41:14.534064+0000","last_fullsized":"2024-09-16T07:41:14.534064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"21'912","reported_seq":936,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:13.239890+0000","last_change":"2024-09-16T07:39:57.170896+0000","last_active":"2024-09-16T07:41:13.239890+0000","last_peered":"2024-09-16T07:41:13.239890+0000","last_clean":"2024-09-16T07:41:13.239890+0000","last_became_active":"2024-09-16T07:39:57.162445+0000","last_became_peered":"2024-09-16T07:39:57.162445+0000","last_unstale":"2024-09-16T07:41:13.239890+0000","last_undegraded":"2024-09-16T07:41:13.239890+0000","last_fullsized":"2024-09-16T07:41:13.239890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"21'723","reported_seq":747,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.754658+0000","last_change":"2024-09-16T07:39:57.113233+0000","last_active":"2024-09-16T07:41:14.754658+0000","last_peered":"2024-09-16T07:41:14.754658+0000","last_clean":"2024-09-16T07:41:14.754658+0000","last_became_active":"2024-09-16T07:39:57.103200+0000","last_became_peered":"2024-09-16T07:39:57.103200+0000","last_unstale":"2024-09-16T07:41:14.754658+0000","last_undegraded":"2024-09-16T07:41:14.754658+0000","last_fullsized":"2024-09-16T07:41:14.754658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5922816,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":723,"num_write_kb":5784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":106,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.838028+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:40:56.838028+0000","last_peered":"2024-09-16T07:40:56.838028+0000","last_clean":"2024-09-16T07:40:56.838028+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:40:56.838028+0000","last_undegraded":"2024-09-16T07:40:56.838028+0000","last_fullsized":"2024-09-16T07:40:56.838028+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.800715+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:40:56.800715+0000","last_peered":"2024-09-16T07:40:56.800715+0000","last_clean":"2024-09-16T07:40:56.800715+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:40:56.800715+0000","last_undegraded":"2024-09-16T07:40:56.800715+0000","last_fullsized":"2024-09-16T07:40:56.800715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'696","reported_seq":720,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.205389+0000","last_change":"2024-09-16T07:39:57.156383+0000","last_active":"2024-09-16T07:41:14.205389+0000","last_peered":"2024-09-16T07:41:14.205389+0000","last_clean":"2024-09-16T07:41:14.205389+0000","last_became_active":"2024-09-16T07:39:57.147931+0000","last_became_peered":"2024-09-16T07:39:57.147931+0000","last_unstale":"2024-09-16T07:41:14.205389+0000","last_undegraded":"2024-09-16T07:41:14.205389+0000","last_fullsized":"2024-09-16T07:41:14.205389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.792768+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:40:56.792768+0000","last_peered":"2024-09-16T07:40:56.792768+0000","last_clean":"2024-09-16T07:40:56.792768+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:40:56.792768+0000","last_undegraded":"2024-09-16T07:40:56.792768+0000","last_fullsized":"2024-09-16T07:40:56.792768+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"21'888","reported_seq":912,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:13.773363+0000","last_change":"2024-09-16T07:39:57.167637+0000","last_active":"2024-09-16T07:41:13.773363+0000","last_peered":"2024-09-16T07:41:13.773363+0000","last_clean":"2024-09-16T07:41:13.773363+0000","last_became_active":"2024-09-16T07:39:57.153421+0000","last_became_peered":"2024-09-16T07:39:57.153421+0000","last_unstale":"2024-09-16T07:41:13.773363+0000","last_undegraded":"2024-09-16T07:41:13.773363+0000","last_fullsized":"2024-09-16T07:41:13.773363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.805392+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:40:56.805392+0000","last_peered":"2024-09-16T07:40:56.805392+0000","last_clean":"2024-09-16T07:40:56.805392+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:40:56.805392+0000","last_undegraded":"2024-09-16T07:40:56.805392+0000","last_fullsized":"2024-09-16T07:40:56.805392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'799","reported_seq":823,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.727035+0000","last_change":"2024-09-16T07:39:57.140655+0000","last_active":"2024-09-16T07:41:14.727035+0000","last_peered":"2024-09-16T07:41:14.727035+0000","last_clean":"2024-09-16T07:41:14.727035+0000","last_became_active":"2024-09-16T07:39:57.125541+0000","last_became_peered":"2024-09-16T07:39:57.125541+0000","last_unstale":"2024-09-16T07:41:14.727035+0000","last_undegraded":"2024-09-16T07:41:14.727035+0000","last_fullsized":"2024-09-16T07:41:14.727035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6545408,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.798659+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:40:56.798659+0000","last_peered":"2024-09-16T07:40:56.798659+0000","last_clean":"2024-09-16T07:40:56.798659+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:40:56.798659+0000","last_undegraded":"2024-09-16T07:40:56.798659+0000","last_fullsized":"2024-09-16T07:40:56.798659+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"21'808","reported_seq":832,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.610609+0000","last_change":"2024-09-16T07:39:57.131217+0000","last_active":"2024-09-16T07:41:14.610609+0000","last_peered":"2024-09-16T07:41:14.610609+0000","last_clean":"2024-09-16T07:41:14.610609+0000","last_became_active":"2024-09-16T07:39:57.119292+0000","last_became_peered":"2024-09-16T07:39:57.119292+0000","last_unstale":"2024-09-16T07:41:14.610609+0000","last_undegraded":"2024-09-16T07:41:14.610609+0000","last_fullsized":"2024-09-16T07:41:14.610609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"21'728","reported_seq":752,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:14.572253+0000","last_change":"2024-09-16T07:39:57.114512+0000","last_active":"2024-09-16T07:41:14.572253+0000","last_peered":"2024-09-16T07:41:14.572253+0000","last_clean":"2024-09-16T07:41:14.572253+0000","last_became_active":"2024-09-16T07:39:57.106844+0000","last_became_peered":"2024-09-16T07:39:57.106844+0000","last_unstale":"2024-09-16T07:41:14.572253+0000","last_undegraded":"2024-09-16T07:41:14.572253+0000","last_fullsized":"2024-09-16T07:41:14.572253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.841488+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:40:56.841488+0000","last_peered":"2024-09-16T07:40:56.841488+0000","last_clean":"2024-09-16T07:40:56.841488+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:40:56.841488+0000","last_undegraded":"2024-09-16T07:40:56.841488+0000","last_fullsized":"2024-09-16T07:40:56.841488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'656","reported_seq":680,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:13.957340+0000","last_change":"2024-09-16T07:39:57.152651+0000","last_active":"2024-09-16T07:41:13.957340+0000","last_peered":"2024-09-16T07:41:13.957340+0000","last_clean":"2024-09-16T07:41:13.957340+0000","last_became_active":"2024-09-16T07:39:57.141965+0000","last_became_peered":"2024-09-16T07:39:57.141965+0000","last_unstale":"2024-09-16T07:41:13.957340+0000","last_undegraded":"2024-09-16T07:41:13.957340+0000","last_fullsized":"2024-09-16T07:41:13.957340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.841883+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:40:56.841883+0000","last_peered":"2024-09-16T07:40:56.841883+0000","last_clean":"2024-09-16T07:40:56.841883+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:40:56.841883+0000","last_undegraded":"2024-09-16T07:40:56.841883+0000","last_fullsized":"2024-09-16T07:40:56.841883+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'728","reported_seq":752,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:12.789053+0000","last_change":"2024-09-16T07:39:57.200290+0000","last_active":"2024-09-16T07:41:12.789053+0000","last_peered":"2024-09-16T07:41:12.789053+0000","last_clean":"2024-09-16T07:41:12.789053+0000","last_became_active":"2024-09-16T07:39:57.189506+0000","last_became_peered":"2024-09-16T07:39:57.189506+0000","last_unstale":"2024-09-16T07:41:12.789053+0000","last_undegraded":"2024-09-16T07:41:12.789053+0000","last_fullsized":"2024-09-16T07:41:12.789053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.839956+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:40:56.839956+0000","last_peered":"2024-09-16T07:40:56.839956+0000","last_clean":"2024-09-16T07:40:56.839956+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:40:56.839956+0000","last_undegraded":"2024-09-16T07:40:56.839956+0000","last_fullsized":"2024-09-16T07:40:56.839956+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'896","reported_seq":920,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:41:13.097330+0000","last_change":"2024-09-16T07:39:57.123748+0000","last_active":"2024-09-16T07:41:13.097330+0000","last_peered":"2024-09-16T07:41:13.097330+0000","last_clean":"2024-09-16T07:41:13.097330+0000","last_became_active":"2024-09-16T07:39:57.106298+0000","last_became_peered":"2024-09-16T07:39:57.106298+0000","last_unstale":"2024-09-16T07:41:13.097330+0000","last_undegraded":"2024-09-16T07:41:13.097330+0000","last_fullsized":"2024-09-16T07:41:13.097330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:55.989577+0000","last_clean_scrub_stamp":"2024-09-16T07:39:55.989577+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.796426+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:40:56.796426+0000","last_peered":"2024-09-16T07:40:56.796426+0000","last_clean":"2024-09-16T07:40:56.796426+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:40:56.796426+0000","last_undegraded":"2024-09-16T07:40:56.796426+0000","last_fullsized":"2024-09-16T07:40:56.796426+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":102973440,"num_objects":1572,"num_object_clones":0,"num_object_copies":4716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12570,"num_write_kb":100560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":154435584,"data_stored":308871168,"data_compressed":15945459,"data_compressed_allocated":154435584,"data_compressed_original":308871168,"omap_allocated":0,"internal_metadata":0},"log_size":12570,"ondisk_log_size":12570,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68260,"kb_used_data":37268,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303580,"statfs":{"total":96636764160,"available":96566865920,"internally_reserved":0,"allocated":38162432,"data_stored":76019599,"data_compressed":3921620,"data_compressed_allocated":37982208,"data_compressed_original":75964416,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59240,"kb_used_data":32408,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94312600,"statfs":{"total":96636764160,"available":96576102400,"internally_reserved":0,"allocated":33185792,"data_stored":66533807,"data_compressed":3431541,"data_compressed_allocated":32985088,"data_compressed_original":66461696,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75320,"kb_used_data":40168,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296520,"statfs":{"total":96636764160,"available":96559636480,"internally_reserved":0,"allocated":41132032,"data_stored":82426287,"data_compressed":4251895,"data_compressed_allocated":40931328,"data_compressed_original":82354176,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75360,"kb_used_data":40208,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296480,"statfs":{"total":96636764160,"available":96559595520,"internally_reserved":0,"allocated":41172992,"data_stored":82516380,"data_compressed":4256661,"data_compressed_allocated":40976384,"data_compressed_original":82444288,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41361408,"data_stored":82722816,"data_compressed":4270616,"data_compressed_allocated":41361408,"data_compressed_original":82722816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41320448,"data_stored":82640896,"data_compressed":4266273,"data_compressed_allocated":41320448,"data_compressed_original":82640896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33345536,"data_stored":66691072,"data_compressed":3442958,"data_compressed_allocated":33345536,"data_compressed_original":66691072,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38408192,"data_stored":76816384,"data_compressed":3965612,"data_compressed_allocated":38408192,"data_compressed_original":76816384,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:41:38.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:38.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:38.971+0000 7f5fc8693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:38.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:38.978+0000 7f5fc8693640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:39.013 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Removed 1819 objects 2024-09-16T07:41:39.013 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Clean up completed and total clean up time :9.88964 2024-09-16T07:41:41.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:41.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:41.237+0000 7f56b9c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:41.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:41.243+0000 7f56b9c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:41.740 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-16T07:41:41.740 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-16T07:41:41.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:41.847+0000 7f8bd1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:41.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:41.860+0000 7f8bd1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:42.326 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_0' removed 2024-09-16T07:41:42.350 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:41:42.351 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:41:42.352 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-09-16T07:41:42.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-09-16T07:41:42.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:42.509+0000 7f2f4de7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:42.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:42.527+0000 7f2f4de7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:43.327 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_1' created 2024-09-16T07:41:43.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:43.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-09-16T07:41:43.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:43.481+0000 7f48dcd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:43.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:43.487+0000 7f48dcd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:43.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:43.507+0000 7f73710d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:43.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:43.522+0000 7f73710d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:43.714 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:43.714 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:43.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:41:43.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:43.820+0000 7f2bfef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:43.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:43.827+0000 7f2bfef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:44.011 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:41:44.012 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:41:44.024 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-09-16T07:41:43.718841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":278180,"kb_used_data":150052,"kb_used_omap":0,"kb_used_meta":128064,"kb_avail":377209180,"statfs":{"total":386547056640,"available":386262200320,"internally_reserved":0,"allocated":153653248,"data_stored":307496073,"data_compressed":15861717,"data_compressed_allocated":152875008,"data_compressed_original":307224576,"omap_allocated":0,"internal_metadata":131137536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-102973440,"num_objects":-1572,"num_object_clones":0,"num_object_copies":-4716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-12570,"num_write_kb":-100560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001602"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":106,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.838028+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:40:56.838028+0000","last_peered":"2024-09-16T07:40:56.838028+0000","last_clean":"2024-09-16T07:40:56.838028+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:40:56.838028+0000","last_undegraded":"2024-09-16T07:40:56.838028+0000","last_fullsized":"2024-09-16T07:40:56.838028+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.800715+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:40:56.800715+0000","last_peered":"2024-09-16T07:40:56.800715+0000","last_clean":"2024-09-16T07:40:56.800715+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:40:56.800715+0000","last_undegraded":"2024-09-16T07:40:56.800715+0000","last_fullsized":"2024-09-16T07:40:56.800715+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.792768+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:40:56.792768+0000","last_peered":"2024-09-16T07:40:56.792768+0000","last_clean":"2024-09-16T07:40:56.792768+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:40:56.792768+0000","last_undegraded":"2024-09-16T07:40:56.792768+0000","last_fullsized":"2024-09-16T07:40:56.792768+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.805392+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:40:56.805392+0000","last_peered":"2024-09-16T07:40:56.805392+0000","last_clean":"2024-09-16T07:40:56.805392+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:40:56.805392+0000","last_undegraded":"2024-09-16T07:40:56.805392+0000","last_fullsized":"2024-09-16T07:40:56.805392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.798659+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:40:56.798659+0000","last_peered":"2024-09-16T07:40:56.798659+0000","last_clean":"2024-09-16T07:40:56.798659+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:40:56.798659+0000","last_undegraded":"2024-09-16T07:40:56.798659+0000","last_fullsized":"2024-09-16T07:40:56.798659+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.841488+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:40:56.841488+0000","last_peered":"2024-09-16T07:40:56.841488+0000","last_clean":"2024-09-16T07:40:56.841488+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:40:56.841488+0000","last_undegraded":"2024-09-16T07:40:56.841488+0000","last_fullsized":"2024-09-16T07:40:56.841488+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.841883+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:40:56.841883+0000","last_peered":"2024-09-16T07:40:56.841883+0000","last_clean":"2024-09-16T07:40:56.841883+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:40:56.841883+0000","last_undegraded":"2024-09-16T07:40:56.841883+0000","last_fullsized":"2024-09-16T07:40:56.841883+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.839956+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:40:56.839956+0000","last_peered":"2024-09-16T07:40:56.839956+0000","last_clean":"2024-09-16T07:40:56.839956+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:40:56.839956+0000","last_undegraded":"2024-09-16T07:40:56.839956+0000","last_fullsized":"2024-09-16T07:40:56.839956+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:41:43.327884+0000","last_change":"2024-09-16T07:41:43.327884+0000","last_active":"2024-09-16T07:41:43.327884+0000","last_peered":"2024-09-16T07:41:43.327884+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:41:43.327884+0000","last_undegraded":"2024-09-16T07:41:43.327884+0000","last_fullsized":"2024-09-16T07:41:43.327884+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-16T07:40:56.796426+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:40:56.796426+0000","last_peered":"2024-09-16T07:40:56.796426+0000","last_clean":"2024-09-16T07:40:56.796426+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:40:56.796426+0000","last_undegraded":"2024-09-16T07:40:56.796426+0000","last_fullsized":"2024-09-16T07:40:56.796426+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68260,"kb_used_data":37268,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303580,"statfs":{"total":96636764160,"available":96566865920,"internally_reserved":0,"allocated":38162432,"data_stored":76019599,"data_compressed":3921620,"data_compressed_allocated":37982208,"data_compressed_original":75964416,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59240,"kb_used_data":32408,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94312600,"statfs":{"total":96636764160,"available":96576102400,"internally_reserved":0,"allocated":33185792,"data_stored":66533807,"data_compressed":3431541,"data_compressed_allocated":32985088,"data_compressed_original":66461696,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75320,"kb_used_data":40168,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296520,"statfs":{"total":96636764160,"available":96559636480,"internally_reserved":0,"allocated":41132032,"data_stored":82426287,"data_compressed":4251895,"data_compressed_allocated":40931328,"data_compressed_original":82354176,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75360,"kb_used_data":40208,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94296480,"statfs":{"total":96636764160,"available":96559595520,"internally_reserved":0,"allocated":41172992,"data_stored":82516380,"data_compressed":4256661,"data_compressed_allocated":40976384,"data_compressed_original":82444288,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:41:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-09-16T07:41:45.361 DEBUG:teuthology.orchestra.run.smithi137:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-09-16T07:41:45.364 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:41:45.364 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:41:45.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:hints = 1 2024-09-16T07:41:45.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:41:45.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object prefix: benchmark_data_smithi137_34635 2024-09-16T07:41:45.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:41:45.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:41:45.598 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:45.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:45.741+0000 7f414d8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:45.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:45.748+0000 7f414d8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:46.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 1 16 198 182 1.42175 1.42188 0.0559447 0.0841015 2024-09-16T07:41:47.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 2 16 376 360 1.40613 1.39062 0.11544 0.0862755 2024-09-16T07:41:48.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:48.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:48.152+0000 7fba33551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:48.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:48.159+0000 7fba33551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:48.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 3 16 553 537 1.39832 1.38281 0.11464 0.0877739 2024-09-16T07:41:49.026 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:49.026 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:49.026 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:41:49.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:49.158+0000 7f75284a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:49.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:49.168+0000 7f75284a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:49.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 4 16 732 716 1.39832 1.39844 0.114022 0.0884212 2024-09-16T07:41:49.445 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:41:49.446 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:41:49.466 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-16T07:41:47.719595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":124928,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377362432,"statfs":{"total":386547056640,"available":386419130368,"internally_reserved":0,"allocated":983040,"data_stored":2019277,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.390494"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.504004+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:41:44.504004+0000","last_peered":"2024-09-16T07:41:44.504004+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:41:44.504004+0000","last_undegraded":"2024-09-16T07:41:44.504004+0000","last_fullsized":"2024-09-16T07:41:44.504004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.492963+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:41:44.492963+0000","last_peered":"2024-09-16T07:41:44.492963+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:41:44.492963+0000","last_undegraded":"2024-09-16T07:41:44.492963+0000","last_fullsized":"2024-09-16T07:41:44.492963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.560005+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:41:44.560005+0000","last_peered":"2024-09-16T07:41:44.560005+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:41:44.560005+0000","last_undegraded":"2024-09-16T07:41:44.560005+0000","last_fullsized":"2024-09-16T07:41:44.560005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.454918+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:41:44.454918+0000","last_peered":"2024-09-16T07:41:44.454918+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:41:44.454918+0000","last_undegraded":"2024-09-16T07:41:44.454918+0000","last_fullsized":"2024-09-16T07:41:44.454918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.521207+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:41:44.521207+0000","last_peered":"2024-09-16T07:41:44.521207+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:41:44.521207+0000","last_undegraded":"2024-09-16T07:41:44.521207+0000","last_fullsized":"2024-09-16T07:41:44.521207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.504437+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:41:44.504437+0000","last_peered":"2024-09-16T07:41:44.504437+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:41:44.504437+0000","last_undegraded":"2024-09-16T07:41:44.504437+0000","last_fullsized":"2024-09-16T07:41:44.504437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.494071+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:41:44.494071+0000","last_peered":"2024-09-16T07:41:44.494071+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:41:44.494071+0000","last_undegraded":"2024-09-16T07:41:44.494071+0000","last_fullsized":"2024-09-16T07:41:44.494071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.480187+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:41:44.480187+0000","last_peered":"2024-09-16T07:41:44.480187+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:41:44.480187+0000","last_undegraded":"2024-09-16T07:41:44.480187+0000","last_fullsized":"2024-09-16T07:41:44.480187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.517010+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:41:44.517010+0000","last_peered":"2024-09-16T07:41:44.517010+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:41:44.517010+0000","last_undegraded":"2024-09-16T07:41:44.517010+0000","last_fullsized":"2024-09-16T07:41:44.517010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":115,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.364219+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:41:44.364219+0000","last_peered":"2024-09-16T07:41:44.364219+0000","last_clean":"2024-09-16T07:41:44.364219+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:41:44.364219+0000","last_undegraded":"2024-09-16T07:41:44.364219+0000","last_fullsized":"2024-09-16T07:41:44.364219+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.364071+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:41:44.364071+0000","last_peered":"2024-09-16T07:41:44.364071+0000","last_clean":"2024-09-16T07:41:44.364071+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:41:44.364071+0000","last_undegraded":"2024-09-16T07:41:44.364071+0000","last_fullsized":"2024-09-16T07:41:44.364071+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.511288+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:41:44.511288+0000","last_peered":"2024-09-16T07:41:44.511288+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:41:44.511288+0000","last_undegraded":"2024-09-16T07:41:44.511288+0000","last_fullsized":"2024-09-16T07:41:44.511288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.360426+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:41:44.360426+0000","last_peered":"2024-09-16T07:41:44.360426+0000","last_clean":"2024-09-16T07:41:44.360426+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:41:44.360426+0000","last_undegraded":"2024-09-16T07:41:44.360426+0000","last_fullsized":"2024-09-16T07:41:44.360426+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.486468+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:41:44.486468+0000","last_peered":"2024-09-16T07:41:44.486468+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:41:44.486468+0000","last_undegraded":"2024-09-16T07:41:44.486468+0000","last_fullsized":"2024-09-16T07:41:44.486468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.380978+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:41:44.380978+0000","last_peered":"2024-09-16T07:41:44.380978+0000","last_clean":"2024-09-16T07:41:44.380978+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:41:44.380978+0000","last_undegraded":"2024-09-16T07:41:44.380978+0000","last_fullsized":"2024-09-16T07:41:44.380978+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.453452+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:41:44.453452+0000","last_peered":"2024-09-16T07:41:44.453452+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:41:44.453452+0000","last_undegraded":"2024-09-16T07:41:44.453452+0000","last_fullsized":"2024-09-16T07:41:44.453452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.373228+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:41:44.373228+0000","last_peered":"2024-09-16T07:41:44.373228+0000","last_clean":"2024-09-16T07:41:44.373228+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:41:44.373228+0000","last_undegraded":"2024-09-16T07:41:44.373228+0000","last_fullsized":"2024-09-16T07:41:44.373228+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.457224+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:41:44.457224+0000","last_peered":"2024-09-16T07:41:44.457224+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:41:44.457224+0000","last_undegraded":"2024-09-16T07:41:44.457224+0000","last_fullsized":"2024-09-16T07:41:44.457224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.374164+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:41:44.374164+0000","last_peered":"2024-09-16T07:41:44.374164+0000","last_clean":"2024-09-16T07:41:44.374164+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:41:44.374164+0000","last_undegraded":"2024-09-16T07:41:44.374164+0000","last_fullsized":"2024-09-16T07:41:44.374164+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.534443+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:41:44.534443+0000","last_peered":"2024-09-16T07:41:44.534443+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:41:44.534443+0000","last_undegraded":"2024-09-16T07:41:44.534443+0000","last_fullsized":"2024-09-16T07:41:44.534443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.374853+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:41:44.374853+0000","last_peered":"2024-09-16T07:41:44.374853+0000","last_clean":"2024-09-16T07:41:44.374853+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:41:44.374853+0000","last_undegraded":"2024-09-16T07:41:44.374853+0000","last_fullsized":"2024-09-16T07:41:44.374853+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.564562+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:41:44.564562+0000","last_peered":"2024-09-16T07:41:44.564562+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:41:44.564562+0000","last_undegraded":"2024-09-16T07:41:44.564562+0000","last_fullsized":"2024-09-16T07:41:44.564562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.365263+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:41:44.365263+0000","last_peered":"2024-09-16T07:41:44.365263+0000","last_clean":"2024-09-16T07:41:44.365263+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:41:44.365263+0000","last_undegraded":"2024-09-16T07:41:44.365263+0000","last_fullsized":"2024-09-16T07:41:44.365263+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.497280+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:41:44.497280+0000","last_peered":"2024-09-16T07:41:44.497280+0000","last_clean":"2024-09-16T07:41:43.327884+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:41:44.497280+0000","last_undegraded":"2024-09-16T07:41:44.497280+0000","last_fullsized":"2024-09-16T07:41:44.497280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T07:41:44.359525+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:41:44.359525+0000","last_peered":"2024-09-16T07:41:44.359525+0000","last_clean":"2024-09-16T07:41:44.359525+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:41:44.359525+0000","last_undegraded":"2024-09-16T07:41:44.359525+0000","last_fullsized":"2024-09-16T07:41:44.359525+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27028,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344812,"statfs":{"total":96636764160,"available":96609087488,"internally_reserved":0,"allocated":200704,"data_stored":62048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35408,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94336432,"statfs":{"total":96636764160,"available":96600506368,"internally_reserved":0,"allocated":262144,"data_stored":652416,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31248,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340592,"statfs":{"total":96636764160,"available":96604766208,"internally_reserved":0,"allocated":262144,"data_stored":652416,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31244,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94340596,"statfs":{"total":96636764160,"available":96604770304,"internally_reserved":0,"allocated":258048,"data_stored":652397,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:41:50.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:50.428 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 5 16 923 907 1.41706 1.49219 0.0863825 0.0876482 2024-09-16T07:41:50.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:50.532+0000 7fd684cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:50.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:50.539+0000 7fd684cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:51.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 6 16 1099 1083 1.41003 1.375 0.122588 0.0876452 2024-09-16T07:41:52.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 7 16 1305 1289 1.43849 1.60938 0.0880641 0.0861425 2024-09-16T07:41:52.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:52.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:52.909+0000 7fc68bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:52.916+0000 7fc68bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:53.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 8 16 1493 1477 1.44225 1.46875 0.0895815 0.086079 2024-09-16T07:41:54.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 9 16 1666 1650 1.43216 1.35156 0.0852829 0.0869347 2024-09-16T07:41:54.469 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:41:54.469 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:41:54.469 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:41:54.469 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:41:54.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:54.594+0000 7f35a4a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:54.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:54.606+0000 7f35a4a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:54.622 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:54.622 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:54.622 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:54.622 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:54.622 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:54.622 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:54.622 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:54.623 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:54.626 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:54.627 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:54.627 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:41:54.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:54.764+0000 7fdbdc148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:54.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:54.776+0000 7fdbdc148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:54.887 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:54.887 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:54.887 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:54.888 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:54.891 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:54.891 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:54.891 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:41:55.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:55.022+0000 7fdf0a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:55.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:55.035+0000 7fdf0a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:55.082 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:55.082 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:55.082 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:41:55.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:55.207+0000 7f3349e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:55.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:55.219+0000 7f3349e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:55.258 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:41:55.331 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:41:55.332 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:41:55.332 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:41:55.335 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:41:55.335 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:41:55.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:55.405+0000 7f589eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:55.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:55.412+0000 7f589eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:55.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 10 16 1844 1828 1.428 1.39062 0.056979 0.0872208 2024-09-16T07:41:56.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 11 16 2022 2006 1.42459 1.39062 0.0879794 0.08737 2024-09-16T07:41:57.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 12 16 2208 2192 1.42696 1.45312 0.108493 0.0871616 2024-09-16T07:41:57.656 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:41:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:57.783+0000 7f0c34a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:57.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:41:57.791+0000 7f0c34a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:41:58.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 13 16 2368 2352 1.41334 1.25 0.0851863 0.0880167 2024-09-16T07:41:59.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 14 16 2552 2536 1.41505 1.4375 0.114802 0.0878834 2024-09-16T07:42:00.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:00.248+0000 7f550ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:00.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:00.255+0000 7f550ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:00.336 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:00.336 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:00.336 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:42:00.337 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:42:00.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 15 16 2730 2714 1.41342 1.39062 0.0816738 0.0882362 2024-09-16T07:42:00.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:00.459+0000 7f9987c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:00.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:00.470+0000 7f9987c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:00.497 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:00.497 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:00.497 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:00.498 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:00.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:00.503 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:00.503 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:42:00.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:00.630+0000 7f2a5d0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:00.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:00.642+0000 7f2a5d0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:00.698 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:00.699 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:00.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:42:00.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:00.894+0000 7f3bf48fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:00.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:00.905+0000 7f3bf48fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:01.076 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:01.079 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:01.079 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:01.079 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:42:01.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:01.199+0000 7ff821111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:01.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:01.211+0000 7ff821111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:01.287 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:01.288 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:01.288 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:01.290 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:01.290 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:01.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 16 16 2900 2884 1.40808 1.32812 0.0222169 0.0882878 2024-09-16T07:42:02.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 17 16 3077 3061 1.40659 1.38281 0.115865 0.088579 2024-09-16T07:42:02.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:02.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:02.797+0000 7ff386151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:02.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:02.805+0000 7ff386151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:03.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 18 16 3257 3241 1.40656 1.40625 0.102334 0.0885531 2024-09-16T07:42:04.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 19 16 3441 3425 1.40819 1.4375 0.0613939 0.0885118 2024-09-16T07:42:05.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:05.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:05.147+0000 7faab9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:05.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:05.154+0000 7faab9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:05.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:42:05.431571+0000 min lat: 0.0166046 max lat: 0.242733 avg lat: 0.0887062 2024-09-16T07:42:05.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:42:05.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 20 16 3614 3598 1.40535 1.35156 0.110376 0.0887062 2024-09-16T07:42:06.291 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:06.291 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:06.291 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:42:06.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:42:06.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 21 16 3780 3764 1.40018 1.29688 0.112798 0.0889427 2024-09-16T07:42:06.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:06.425+0000 7f8e826d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:06.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:06.438+0000 7f8e826d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:06.457 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:06.458 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:06.461 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:06.462 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:06.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:42:06.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:06.600+0000 7fca0b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:06.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:06.615+0000 7fca0b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:06.701 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:06.703 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:06.703 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:06.704 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:42:06.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:06.851+0000 7f19c9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:06.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:06.866+0000 7f19c9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:07.027 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:07.027 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:07.027 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:07.027 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:07.027 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:07.028 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:07.028 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:07.028 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:07.028 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:07.028 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:07.028 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:07.028 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:07.030 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:07.030 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:07.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:42:07.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:07.147+0000 7f8bd4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:07.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:07.159+0000 7f8bd4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:07.283 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:07.283 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:07.283 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:07.283 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:07.283 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:07.284 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:07.284 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:07.284 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:07.284 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:07.284 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:07.284 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:07.284 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:07.286 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:07.286 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:07.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 22 16 3968 3952 1.40329 1.46875 0.104055 0.0888879 2024-09-16T07:42:07.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:07.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:07.562+0000 7f6c87c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:07.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:07.569+0000 7f6c87c88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:08.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 23 16 4134 4118 1.39866 1.29688 0.0522547 0.0891271 2024-09-16T07:42:09.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 24 16 4301 4285 1.39474 1.30469 0.0749817 0.0894339 2024-09-16T07:42:09.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:09.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:09.989+0000 7fb8c7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:09.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:09.995+0000 7fb8c7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:10.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 25 16 4472 4456 1.39238 1.33594 0.0988983 0.0895789 2024-09-16T07:42:11.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 26 16 4632 4616 1.3869 1.25 0.101716 0.0899936 2024-09-16T07:42:12.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:12.287 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:12.287 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:12.288 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:42:12.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:42:12.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:12.407+0000 7f013b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:12.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:12.415+0000 7f013b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:12.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 27 16 4807 4791 1.38617 1.36719 0.0975572 0.0899344 2024-09-16T07:42:12.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:12.424+0000 7f169bf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:12.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:12.437+0000 7f169bf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:12.470 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:12.470 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:12.471 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:12.474 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:12.474 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:12.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:42:12.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:12.605+0000 7f8f7c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:12.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:12.620+0000 7f8f7c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:12.674 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:12.674 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:12.674 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:12.674 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:12.674 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:12.674 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:12.674 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:12.675 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:12.675 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:12.675 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:12.675 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:12.675 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:12.677 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:12.677 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:12.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:42:12.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:12.794+0000 7f3d1e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:12.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:12.807+0000 7f3d1e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:12.840 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:12.840 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:12.840 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:12.840 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:12.840 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:12.840 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:12.841 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:12.844 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:12.845 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:12.845 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:42:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:13.004+0000 7f893e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:13.018+0000 7f893e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:13.116 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:13.116 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:13.116 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:13.116 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:13.116 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:13.117 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:13.117 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:13.117 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:13.117 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:13.117 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:13.117 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:13.117 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:13.119 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:13.119 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:13.430 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 28 16 4985 4969 1.38632 1.39062 0.116177 0.0899593 2024-09-16T07:42:14.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 29 16 5169 5153 1.38808 1.4375 0.0549971 0.0898514 2024-09-16T07:42:14.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:15.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:15.006+0000 7fe77bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:15.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:15.013+0000 7fe77bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:15.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 30 16 5322 5306 1.38165 1.19531 0.0938821 0.090231 2024-09-16T07:42:16.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 31 16 5500 5484 1.38194 1.39062 0.101761 0.0903191 2024-09-16T07:42:17.306 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:17.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 32 16 5668 5652 1.37976 1.3125 0.0857851 0.0904287 2024-09-16T07:42:17.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:17.452+0000 7f1e1d151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:17.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:17.459+0000 7f1e1d151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:18.120 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:18.121 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:18.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:42:18.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:18.250+0000 7f6d430bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:18.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:18.259+0000 7f6d430bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:18.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 33 16 5829 5813 1.37606 1.25781 0.0705043 0.0906799 2024-09-16T07:42:18.510 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:42:18.511 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:42:18.527 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-09-16T07:42:17.724893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43287091,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5293,"num_write_kb":42804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5267,"ondisk_log_size":5267,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":266456,"kb_used_data":61972,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377220904,"statfs":{"total":386547056640,"available":386274205696,"internally_reserved":0,"allocated":63459328,"data_stored":126869749,"data_compressed":6532032,"data_compressed_allocated":62533632,"data_compressed_original":126541824,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002353"},"pg_stats":[{"pgid":"4.f","version":"25'408","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.061101+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:13.061101+0000","last_peered":"2024-09-16T07:42:13.061101+0000","last_clean":"2024-09-16T07:42:13.061101+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:13.061101+0000","last_undegraded":"2024-09-16T07:42:13.061101+0000","last_fullsized":"2024-09-16T07:42:13.061101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"25'344","reported_seq":356,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.610410+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:14.610410+0000","last_peered":"2024-09-16T07:42:14.610410+0000","last_clean":"2024-09-16T07:42:14.610410+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:14.610410+0000","last_undegraded":"2024-09-16T07:42:14.610410+0000","last_fullsized":"2024-09-16T07:42:14.610410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"25'248","reported_seq":260,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.482957+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:14.482957+0000","last_peered":"2024-09-16T07:42:14.482957+0000","last_clean":"2024-09-16T07:42:14.482957+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:14.482957+0000","last_undegraded":"2024-09-16T07:42:14.482957+0000","last_fullsized":"2024-09-16T07:42:14.482957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"25'328","reported_seq":340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.658516+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:14.658516+0000","last_peered":"2024-09-16T07:42:14.658516+0000","last_clean":"2024-09-16T07:42:14.658516+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:14.658516+0000","last_undegraded":"2024-09-16T07:42:14.658516+0000","last_fullsized":"2024-09-16T07:42:14.658516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"25'298","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.752714+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:14.752714+0000","last_peered":"2024-09-16T07:42:14.752714+0000","last_clean":"2024-09-16T07:42:14.752714+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:14.752714+0000","last_undegraded":"2024-09-16T07:42:14.752714+0000","last_fullsized":"2024-09-16T07:42:14.752714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2441216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"25'376","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.732988+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:14.732988+0000","last_peered":"2024-09-16T07:42:14.732988+0000","last_clean":"2024-09-16T07:42:14.732988+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:14.732988+0000","last_undegraded":"2024-09-16T07:42:14.732988+0000","last_fullsized":"2024-09-16T07:42:14.732988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"25'320","reported_seq":332,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.321549+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:14.321549+0000","last_peered":"2024-09-16T07:42:14.321549+0000","last_clean":"2024-09-16T07:42:14.321549+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:14.321549+0000","last_undegraded":"2024-09-16T07:42:14.321549+0000","last_fullsized":"2024-09-16T07:42:14.321549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"25'296","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.185833+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:14.185833+0000","last_peered":"2024-09-16T07:42:14.185833+0000","last_clean":"2024-09-16T07:42:14.185833+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:14.185833+0000","last_undegraded":"2024-09-16T07:42:14.185833+0000","last_fullsized":"2024-09-16T07:42:14.185833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"25'306","reported_seq":318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.755784+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:14.755784+0000","last_peered":"2024-09-16T07:42:14.755784+0000","last_clean":"2024-09-16T07:42:14.755784+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:14.755784+0000","last_undegraded":"2024-09-16T07:42:14.755784+0000","last_fullsized":"2024-09-16T07:42:14.755784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2506752,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362483+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:41:45.362483+0000","last_peered":"2024-09-16T07:41:45.362483+0000","last_clean":"2024-09-16T07:41:45.362483+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:41:45.362483+0000","last_undegraded":"2024-09-16T07:41:45.362483+0000","last_fullsized":"2024-09-16T07:41:45.362483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.363554+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:41:45.363554+0000","last_peered":"2024-09-16T07:41:45.363554+0000","last_clean":"2024-09-16T07:41:45.363554+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:41:45.363554+0000","last_undegraded":"2024-09-16T07:41:45.363554+0000","last_fullsized":"2024-09-16T07:41:45.363554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'424","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.563276+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:14.563276+0000","last_peered":"2024-09-16T07:42:14.563276+0000","last_clean":"2024-09-16T07:42:14.563276+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:14.563276+0000","last_undegraded":"2024-09-16T07:42:14.563276+0000","last_fullsized":"2024-09-16T07:42:14.563276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.360753+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:41:45.360753+0000","last_peered":"2024-09-16T07:41:45.360753+0000","last_clean":"2024-09-16T07:41:45.360753+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:41:45.360753+0000","last_undegraded":"2024-09-16T07:41:45.360753+0000","last_fullsized":"2024-09-16T07:41:45.360753+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"25'264","reported_seq":276,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.029102+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:14.029102+0000","last_peered":"2024-09-16T07:42:14.029102+0000","last_clean":"2024-09-16T07:42:14.029102+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:14.029102+0000","last_undegraded":"2024-09-16T07:42:14.029102+0000","last_fullsized":"2024-09-16T07:42:14.029102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365844+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:41:45.365844+0000","last_peered":"2024-09-16T07:41:45.365844+0000","last_clean":"2024-09-16T07:41:45.365844+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:41:45.365844+0000","last_undegraded":"2024-09-16T07:41:45.365844+0000","last_fullsized":"2024-09-16T07:41:45.365844+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"25'280","reported_seq":292,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.841873+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:13.841873+0000","last_peered":"2024-09-16T07:42:13.841873+0000","last_clean":"2024-09-16T07:42:13.841873+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:13.841873+0000","last_undegraded":"2024-09-16T07:42:13.841873+0000","last_fullsized":"2024-09-16T07:42:13.841873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365558+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:41:45.365558+0000","last_peered":"2024-09-16T07:41:45.365558+0000","last_clean":"2024-09-16T07:41:45.365558+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:41:45.365558+0000","last_undegraded":"2024-09-16T07:41:45.365558+0000","last_fullsized":"2024-09-16T07:41:45.365558+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"25'336","reported_seq":348,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.489898+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:13.489898+0000","last_peered":"2024-09-16T07:42:13.489898+0000","last_clean":"2024-09-16T07:42:13.489898+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:13.489898+0000","last_undegraded":"2024-09-16T07:42:13.489898+0000","last_fullsized":"2024-09-16T07:42:13.489898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.367923+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:41:45.367923+0000","last_peered":"2024-09-16T07:41:45.367923+0000","last_clean":"2024-09-16T07:41:45.367923+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:41:45.367923+0000","last_undegraded":"2024-09-16T07:41:45.367923+0000","last_fullsized":"2024-09-16T07:41:45.367923+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.768066+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:13.768066+0000","last_peered":"2024-09-16T07:42:13.768066+0000","last_clean":"2024-09-16T07:42:13.768066+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:13.768066+0000","last_undegraded":"2024-09-16T07:42:13.768066+0000","last_fullsized":"2024-09-16T07:42:13.768066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.368368+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:41:45.368368+0000","last_peered":"2024-09-16T07:41:45.368368+0000","last_clean":"2024-09-16T07:41:45.368368+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:41:45.368368+0000","last_undegraded":"2024-09-16T07:41:45.368368+0000","last_fullsized":"2024-09-16T07:41:45.368368+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"25'360","reported_seq":372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.538222+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:14.538222+0000","last_peered":"2024-09-16T07:42:14.538222+0000","last_clean":"2024-09-16T07:42:14.538222+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:14.538222+0000","last_undegraded":"2024-09-16T07:42:14.538222+0000","last_fullsized":"2024-09-16T07:42:14.538222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362929+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:41:45.362929+0000","last_peered":"2024-09-16T07:41:45.362929+0000","last_clean":"2024-09-16T07:41:45.362929+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:41:45.362929+0000","last_undegraded":"2024-09-16T07:41:45.362929+0000","last_fullsized":"2024-09-16T07:41:45.362929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.613352+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:14.613352+0000","last_peered":"2024-09-16T07:42:14.613352+0000","last_clean":"2024-09-16T07:42:14.613352+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:14.613352+0000","last_undegraded":"2024-09-16T07:42:14.613352+0000","last_fullsized":"2024-09-16T07:42:14.613352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.359574+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:41:45.359574+0000","last_peered":"2024-09-16T07:41:45.359574+0000","last_clean":"2024-09-16T07:41:45.359574+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:41:45.359574+0000","last_undegraded":"2024-09-16T07:41:45.359574+0000","last_fullsized":"2024-09-16T07:41:45.359574+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64020480,"data_stored":128040960,"data_compressed":6608160,"data_compressed_allocated":64020480,"data_compressed_original":128040960,"omap_allocated":0,"internal_metadata":0},"log_size":5212,"ondisk_log_size":5212,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63208,"kb_used_data":18328,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94308632,"statfs":{"total":96636764160,"available":96572039168,"internally_reserved":0,"allocated":18767872,"data_stored":37170858,"data_compressed":1914753,"data_compressed_allocated":18550784,"data_compressed_original":37101568,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75508,"kb_used_data":18148,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94296332,"statfs":{"total":96636764160,"available":96559443968,"internally_reserved":0,"allocated":18583552,"data_stored":37269706,"data_compressed":1919386,"data_compressed_allocated":18345984,"data_compressed_original":37183488,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59268,"kb_used_data":14388,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312572,"statfs":{"total":96636764160,"available":96576073728,"internally_reserved":0,"allocated":14733312,"data_stored":29569226,"data_compressed":1522082,"data_compressed_allocated":14495744,"data_compressed_original":29483008,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68472,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303368,"statfs":{"total":96636764160,"available":96566648832,"internally_reserved":0,"allocated":11374592,"data_stored":22859959,"data_compressed":1175811,"data_compressed_allocated":11141120,"data_compressed_original":22773760,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11472896,"data_stored":22945792,"data_compressed":1184267,"data_compressed_allocated":11472896,"data_compressed_original":22945792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":29499392,"data_compressed":1522501,"data_compressed_allocated":14749696,"data_compressed_original":29499392,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18817024,"data_stored":37634048,"data_compressed":1942224,"data_compressed_allocated":18817024,"data_compressed_original":37634048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18980864,"data_stored":37961728,"data_compressed":1959168,"data_compressed_allocated":18980864,"data_compressed_original":37961728,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:42:19.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 34 16 5991 5975 1.37281 1.26562 0.0627262 0.0908792 2024-09-16T07:42:19.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:20.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:20.062+0000 7f717b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:20.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:20.070+0000 7f717b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:20.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 35 16 6144 6128 1.36774 1.19531 0.0696922 0.0912437 2024-09-16T07:42:21.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 36 16 6313 6297 1.36642 1.32031 0.0716582 0.0913525 2024-09-16T07:42:22.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 37 16 6461 6445 1.36073 1.15625 0.108842 0.0916688 2024-09-16T07:42:22.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:22.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:22.723+0000 7f30dd26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:22.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:22.730+0000 7f30dd26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:23.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 38 16 6607 6591 1.35494 1.14062 0.0818657 0.0921166 2024-09-16T07:42:23.530 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:23.530 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:23.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:42:23.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:23.664+0000 7f6ee0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:23.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:23.677+0000 7f6ee0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:23.955 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:42:23.955 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:42:23.978 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-16T07:42:23.726009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43287091,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5293,"num_write_kb":42804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5267,"ondisk_log_size":5267,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":266456,"kb_used_data":61972,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377220904,"statfs":{"total":386547056640,"available":386274205696,"internally_reserved":0,"allocated":63459328,"data_stored":126869749,"data_compressed":6532032,"data_compressed_allocated":62533632,"data_compressed_original":126541824,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002305"},"pg_stats":[{"pgid":"4.f","version":"25'408","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.061101+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:13.061101+0000","last_peered":"2024-09-16T07:42:13.061101+0000","last_clean":"2024-09-16T07:42:13.061101+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:13.061101+0000","last_undegraded":"2024-09-16T07:42:13.061101+0000","last_fullsized":"2024-09-16T07:42:13.061101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"25'344","reported_seq":356,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.610410+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:14.610410+0000","last_peered":"2024-09-16T07:42:14.610410+0000","last_clean":"2024-09-16T07:42:14.610410+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:14.610410+0000","last_undegraded":"2024-09-16T07:42:14.610410+0000","last_fullsized":"2024-09-16T07:42:14.610410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"25'248","reported_seq":260,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.482957+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:14.482957+0000","last_peered":"2024-09-16T07:42:14.482957+0000","last_clean":"2024-09-16T07:42:14.482957+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:14.482957+0000","last_undegraded":"2024-09-16T07:42:14.482957+0000","last_fullsized":"2024-09-16T07:42:14.482957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"25'328","reported_seq":340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.658516+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:14.658516+0000","last_peered":"2024-09-16T07:42:14.658516+0000","last_clean":"2024-09-16T07:42:14.658516+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:14.658516+0000","last_undegraded":"2024-09-16T07:42:14.658516+0000","last_fullsized":"2024-09-16T07:42:14.658516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"25'298","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.752714+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:14.752714+0000","last_peered":"2024-09-16T07:42:14.752714+0000","last_clean":"2024-09-16T07:42:14.752714+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:14.752714+0000","last_undegraded":"2024-09-16T07:42:14.752714+0000","last_fullsized":"2024-09-16T07:42:14.752714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2441216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"25'376","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.732988+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:14.732988+0000","last_peered":"2024-09-16T07:42:14.732988+0000","last_clean":"2024-09-16T07:42:14.732988+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:14.732988+0000","last_undegraded":"2024-09-16T07:42:14.732988+0000","last_fullsized":"2024-09-16T07:42:14.732988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"25'320","reported_seq":332,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.321549+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:14.321549+0000","last_peered":"2024-09-16T07:42:14.321549+0000","last_clean":"2024-09-16T07:42:14.321549+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:14.321549+0000","last_undegraded":"2024-09-16T07:42:14.321549+0000","last_fullsized":"2024-09-16T07:42:14.321549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"25'296","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.185833+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:14.185833+0000","last_peered":"2024-09-16T07:42:14.185833+0000","last_clean":"2024-09-16T07:42:14.185833+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:14.185833+0000","last_undegraded":"2024-09-16T07:42:14.185833+0000","last_fullsized":"2024-09-16T07:42:14.185833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"25'306","reported_seq":318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.755784+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:14.755784+0000","last_peered":"2024-09-16T07:42:14.755784+0000","last_clean":"2024-09-16T07:42:14.755784+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:14.755784+0000","last_undegraded":"2024-09-16T07:42:14.755784+0000","last_fullsized":"2024-09-16T07:42:14.755784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2506752,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362483+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:41:45.362483+0000","last_peered":"2024-09-16T07:41:45.362483+0000","last_clean":"2024-09-16T07:41:45.362483+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:41:45.362483+0000","last_undegraded":"2024-09-16T07:41:45.362483+0000","last_fullsized":"2024-09-16T07:41:45.362483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.363554+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:41:45.363554+0000","last_peered":"2024-09-16T07:41:45.363554+0000","last_clean":"2024-09-16T07:41:45.363554+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:41:45.363554+0000","last_undegraded":"2024-09-16T07:41:45.363554+0000","last_fullsized":"2024-09-16T07:41:45.363554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'424","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.563276+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:14.563276+0000","last_peered":"2024-09-16T07:42:14.563276+0000","last_clean":"2024-09-16T07:42:14.563276+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:14.563276+0000","last_undegraded":"2024-09-16T07:42:14.563276+0000","last_fullsized":"2024-09-16T07:42:14.563276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.360753+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:41:45.360753+0000","last_peered":"2024-09-16T07:41:45.360753+0000","last_clean":"2024-09-16T07:41:45.360753+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:41:45.360753+0000","last_undegraded":"2024-09-16T07:41:45.360753+0000","last_fullsized":"2024-09-16T07:41:45.360753+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"25'264","reported_seq":276,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.029102+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:14.029102+0000","last_peered":"2024-09-16T07:42:14.029102+0000","last_clean":"2024-09-16T07:42:14.029102+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:14.029102+0000","last_undegraded":"2024-09-16T07:42:14.029102+0000","last_fullsized":"2024-09-16T07:42:14.029102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365844+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:41:45.365844+0000","last_peered":"2024-09-16T07:41:45.365844+0000","last_clean":"2024-09-16T07:41:45.365844+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:41:45.365844+0000","last_undegraded":"2024-09-16T07:41:45.365844+0000","last_fullsized":"2024-09-16T07:41:45.365844+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"25'280","reported_seq":292,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.841873+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:13.841873+0000","last_peered":"2024-09-16T07:42:13.841873+0000","last_clean":"2024-09-16T07:42:13.841873+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:13.841873+0000","last_undegraded":"2024-09-16T07:42:13.841873+0000","last_fullsized":"2024-09-16T07:42:13.841873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365558+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:41:45.365558+0000","last_peered":"2024-09-16T07:41:45.365558+0000","last_clean":"2024-09-16T07:41:45.365558+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:41:45.365558+0000","last_undegraded":"2024-09-16T07:41:45.365558+0000","last_fullsized":"2024-09-16T07:41:45.365558+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"25'336","reported_seq":348,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.489898+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:13.489898+0000","last_peered":"2024-09-16T07:42:13.489898+0000","last_clean":"2024-09-16T07:42:13.489898+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:13.489898+0000","last_undegraded":"2024-09-16T07:42:13.489898+0000","last_fullsized":"2024-09-16T07:42:13.489898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.367923+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:41:45.367923+0000","last_peered":"2024-09-16T07:41:45.367923+0000","last_clean":"2024-09-16T07:41:45.367923+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:41:45.367923+0000","last_undegraded":"2024-09-16T07:41:45.367923+0000","last_fullsized":"2024-09-16T07:41:45.367923+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.768066+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:13.768066+0000","last_peered":"2024-09-16T07:42:13.768066+0000","last_clean":"2024-09-16T07:42:13.768066+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:13.768066+0000","last_undegraded":"2024-09-16T07:42:13.768066+0000","last_fullsized":"2024-09-16T07:42:13.768066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.368368+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:41:45.368368+0000","last_peered":"2024-09-16T07:41:45.368368+0000","last_clean":"2024-09-16T07:41:45.368368+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:41:45.368368+0000","last_undegraded":"2024-09-16T07:41:45.368368+0000","last_fullsized":"2024-09-16T07:41:45.368368+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"25'360","reported_seq":372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.538222+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:14.538222+0000","last_peered":"2024-09-16T07:42:14.538222+0000","last_clean":"2024-09-16T07:42:14.538222+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:14.538222+0000","last_undegraded":"2024-09-16T07:42:14.538222+0000","last_fullsized":"2024-09-16T07:42:14.538222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362929+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:41:45.362929+0000","last_peered":"2024-09-16T07:41:45.362929+0000","last_clean":"2024-09-16T07:41:45.362929+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:41:45.362929+0000","last_undegraded":"2024-09-16T07:41:45.362929+0000","last_fullsized":"2024-09-16T07:41:45.362929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.613352+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:14.613352+0000","last_peered":"2024-09-16T07:42:14.613352+0000","last_clean":"2024-09-16T07:42:14.613352+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:14.613352+0000","last_undegraded":"2024-09-16T07:42:14.613352+0000","last_fullsized":"2024-09-16T07:42:14.613352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.359574+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:41:45.359574+0000","last_peered":"2024-09-16T07:41:45.359574+0000","last_clean":"2024-09-16T07:41:45.359574+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:41:45.359574+0000","last_undegraded":"2024-09-16T07:41:45.359574+0000","last_fullsized":"2024-09-16T07:41:45.359574+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64020480,"data_stored":128040960,"data_compressed":6608160,"data_compressed_allocated":64020480,"data_compressed_original":128040960,"omap_allocated":0,"internal_metadata":0},"log_size":5212,"ondisk_log_size":5212,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63208,"kb_used_data":18328,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94308632,"statfs":{"total":96636764160,"available":96572039168,"internally_reserved":0,"allocated":18767872,"data_stored":37170858,"data_compressed":1914753,"data_compressed_allocated":18550784,"data_compressed_original":37101568,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75508,"kb_used_data":18148,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94296332,"statfs":{"total":96636764160,"available":96559443968,"internally_reserved":0,"allocated":18583552,"data_stored":37269706,"data_compressed":1919386,"data_compressed_allocated":18345984,"data_compressed_original":37183488,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59268,"kb_used_data":14388,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312572,"statfs":{"total":96636764160,"available":96576073728,"internally_reserved":0,"allocated":14733312,"data_stored":29569226,"data_compressed":1522082,"data_compressed_allocated":14495744,"data_compressed_original":29483008,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68472,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303368,"statfs":{"total":96636764160,"available":96566648832,"internally_reserved":0,"allocated":11374592,"data_stored":22859959,"data_compressed":1175811,"data_compressed_allocated":11141120,"data_compressed_original":22773760,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11472896,"data_stored":22945792,"data_compressed":1184267,"data_compressed_allocated":11472896,"data_compressed_original":22945792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":29499392,"data_compressed":1522501,"data_compressed_allocated":14749696,"data_compressed_original":29499392,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18817024,"data_stored":37634048,"data_compressed":1942224,"data_compressed_allocated":18817024,"data_compressed_original":37634048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18980864,"data_stored":37961728,"data_compressed":1959168,"data_compressed_allocated":18980864,"data_compressed_original":37961728,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:42:24.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 39 16 6768 6752 1.35245 1.25781 0.102601 0.092319 2024-09-16T07:42:25.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:25.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:25.217+0000 7fe9c2511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:25.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:25.225+0000 7fe9c2511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:25.431 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:42:25.433350+0000 min lat: 0.0166046 max lat: 0.265775 avg lat: 0.0924907 2024-09-16T07:42:25.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:42:25.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 40 16 6917 6901 1.34773 1.16406 0.150255 0.0924907 2024-09-16T07:42:26.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 41 16 7082 7066 1.3463 1.28906 0.0532117 0.0927344 2024-09-16T07:42:27.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 42 16 7243 7227 1.34419 1.25781 0.165074 0.0929152 2024-09-16T07:42:27.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:27.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:27.590+0000 7f8dbd791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:27.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:27.597+0000 7f8dbd791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:28.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 43 16 7399 7383 1.34127 1.21875 0.131518 0.0930145 2024-09-16T07:42:28.980 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:28.980 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:28.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:42:29.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:29.125+0000 7f7c69eb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:29.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:29.133+0000 7f7c69eb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:29.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 44 16 7552 7536 1.33795 1.19531 0.228503 0.0931914 2024-09-16T07:42:29.461 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:42:29.462 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:42:29.484 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-16T07:42:27.726800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43287091,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5293,"num_write_kb":42804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5267,"ondisk_log_size":5267,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":266456,"kb_used_data":61972,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377220904,"statfs":{"total":386547056640,"available":386274205696,"internally_reserved":0,"allocated":63459328,"data_stored":126869749,"data_compressed":6532032,"data_compressed_allocated":62533632,"data_compressed_original":126541824,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002326"},"pg_stats":[{"pgid":"4.f","version":"25'408","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.061101+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:13.061101+0000","last_peered":"2024-09-16T07:42:13.061101+0000","last_clean":"2024-09-16T07:42:13.061101+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:13.061101+0000","last_undegraded":"2024-09-16T07:42:13.061101+0000","last_fullsized":"2024-09-16T07:42:13.061101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"25'344","reported_seq":356,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.610410+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:14.610410+0000","last_peered":"2024-09-16T07:42:14.610410+0000","last_clean":"2024-09-16T07:42:14.610410+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:14.610410+0000","last_undegraded":"2024-09-16T07:42:14.610410+0000","last_fullsized":"2024-09-16T07:42:14.610410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"25'248","reported_seq":260,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.482957+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:14.482957+0000","last_peered":"2024-09-16T07:42:14.482957+0000","last_clean":"2024-09-16T07:42:14.482957+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:14.482957+0000","last_undegraded":"2024-09-16T07:42:14.482957+0000","last_fullsized":"2024-09-16T07:42:14.482957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"25'328","reported_seq":340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.658516+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:14.658516+0000","last_peered":"2024-09-16T07:42:14.658516+0000","last_clean":"2024-09-16T07:42:14.658516+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:14.658516+0000","last_undegraded":"2024-09-16T07:42:14.658516+0000","last_fullsized":"2024-09-16T07:42:14.658516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"25'298","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.752714+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:14.752714+0000","last_peered":"2024-09-16T07:42:14.752714+0000","last_clean":"2024-09-16T07:42:14.752714+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:14.752714+0000","last_undegraded":"2024-09-16T07:42:14.752714+0000","last_fullsized":"2024-09-16T07:42:14.752714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2441216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"25'376","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.732988+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:14.732988+0000","last_peered":"2024-09-16T07:42:14.732988+0000","last_clean":"2024-09-16T07:42:14.732988+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:14.732988+0000","last_undegraded":"2024-09-16T07:42:14.732988+0000","last_fullsized":"2024-09-16T07:42:14.732988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"25'320","reported_seq":332,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.321549+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:14.321549+0000","last_peered":"2024-09-16T07:42:14.321549+0000","last_clean":"2024-09-16T07:42:14.321549+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:14.321549+0000","last_undegraded":"2024-09-16T07:42:14.321549+0000","last_fullsized":"2024-09-16T07:42:14.321549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"25'296","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.185833+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:14.185833+0000","last_peered":"2024-09-16T07:42:14.185833+0000","last_clean":"2024-09-16T07:42:14.185833+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:14.185833+0000","last_undegraded":"2024-09-16T07:42:14.185833+0000","last_fullsized":"2024-09-16T07:42:14.185833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"25'306","reported_seq":318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.755784+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:14.755784+0000","last_peered":"2024-09-16T07:42:14.755784+0000","last_clean":"2024-09-16T07:42:14.755784+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:14.755784+0000","last_undegraded":"2024-09-16T07:42:14.755784+0000","last_fullsized":"2024-09-16T07:42:14.755784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2506752,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362483+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:41:45.362483+0000","last_peered":"2024-09-16T07:41:45.362483+0000","last_clean":"2024-09-16T07:41:45.362483+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:41:45.362483+0000","last_undegraded":"2024-09-16T07:41:45.362483+0000","last_fullsized":"2024-09-16T07:41:45.362483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.363554+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:41:45.363554+0000","last_peered":"2024-09-16T07:41:45.363554+0000","last_clean":"2024-09-16T07:41:45.363554+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:41:45.363554+0000","last_undegraded":"2024-09-16T07:41:45.363554+0000","last_fullsized":"2024-09-16T07:41:45.363554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'424","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.563276+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:14.563276+0000","last_peered":"2024-09-16T07:42:14.563276+0000","last_clean":"2024-09-16T07:42:14.563276+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:14.563276+0000","last_undegraded":"2024-09-16T07:42:14.563276+0000","last_fullsized":"2024-09-16T07:42:14.563276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.360753+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:41:45.360753+0000","last_peered":"2024-09-16T07:41:45.360753+0000","last_clean":"2024-09-16T07:41:45.360753+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:41:45.360753+0000","last_undegraded":"2024-09-16T07:41:45.360753+0000","last_fullsized":"2024-09-16T07:41:45.360753+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"25'264","reported_seq":276,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.029102+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:14.029102+0000","last_peered":"2024-09-16T07:42:14.029102+0000","last_clean":"2024-09-16T07:42:14.029102+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:14.029102+0000","last_undegraded":"2024-09-16T07:42:14.029102+0000","last_fullsized":"2024-09-16T07:42:14.029102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365844+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:41:45.365844+0000","last_peered":"2024-09-16T07:41:45.365844+0000","last_clean":"2024-09-16T07:41:45.365844+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:41:45.365844+0000","last_undegraded":"2024-09-16T07:41:45.365844+0000","last_fullsized":"2024-09-16T07:41:45.365844+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"25'280","reported_seq":292,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.841873+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:13.841873+0000","last_peered":"2024-09-16T07:42:13.841873+0000","last_clean":"2024-09-16T07:42:13.841873+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:13.841873+0000","last_undegraded":"2024-09-16T07:42:13.841873+0000","last_fullsized":"2024-09-16T07:42:13.841873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365558+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:41:45.365558+0000","last_peered":"2024-09-16T07:41:45.365558+0000","last_clean":"2024-09-16T07:41:45.365558+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:41:45.365558+0000","last_undegraded":"2024-09-16T07:41:45.365558+0000","last_fullsized":"2024-09-16T07:41:45.365558+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"25'336","reported_seq":348,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.489898+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:13.489898+0000","last_peered":"2024-09-16T07:42:13.489898+0000","last_clean":"2024-09-16T07:42:13.489898+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:13.489898+0000","last_undegraded":"2024-09-16T07:42:13.489898+0000","last_fullsized":"2024-09-16T07:42:13.489898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.367923+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:41:45.367923+0000","last_peered":"2024-09-16T07:41:45.367923+0000","last_clean":"2024-09-16T07:41:45.367923+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:41:45.367923+0000","last_undegraded":"2024-09-16T07:41:45.367923+0000","last_fullsized":"2024-09-16T07:41:45.367923+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.768066+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:13.768066+0000","last_peered":"2024-09-16T07:42:13.768066+0000","last_clean":"2024-09-16T07:42:13.768066+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:13.768066+0000","last_undegraded":"2024-09-16T07:42:13.768066+0000","last_fullsized":"2024-09-16T07:42:13.768066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.368368+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:41:45.368368+0000","last_peered":"2024-09-16T07:41:45.368368+0000","last_clean":"2024-09-16T07:41:45.368368+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:41:45.368368+0000","last_undegraded":"2024-09-16T07:41:45.368368+0000","last_fullsized":"2024-09-16T07:41:45.368368+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"25'360","reported_seq":372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.538222+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:14.538222+0000","last_peered":"2024-09-16T07:42:14.538222+0000","last_clean":"2024-09-16T07:42:14.538222+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:14.538222+0000","last_undegraded":"2024-09-16T07:42:14.538222+0000","last_fullsized":"2024-09-16T07:42:14.538222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362929+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:41:45.362929+0000","last_peered":"2024-09-16T07:41:45.362929+0000","last_clean":"2024-09-16T07:41:45.362929+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:41:45.362929+0000","last_undegraded":"2024-09-16T07:41:45.362929+0000","last_fullsized":"2024-09-16T07:41:45.362929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.613352+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:14.613352+0000","last_peered":"2024-09-16T07:42:14.613352+0000","last_clean":"2024-09-16T07:42:14.613352+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:14.613352+0000","last_undegraded":"2024-09-16T07:42:14.613352+0000","last_fullsized":"2024-09-16T07:42:14.613352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.359574+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:41:45.359574+0000","last_peered":"2024-09-16T07:41:45.359574+0000","last_clean":"2024-09-16T07:41:45.359574+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:41:45.359574+0000","last_undegraded":"2024-09-16T07:41:45.359574+0000","last_fullsized":"2024-09-16T07:41:45.359574+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64020480,"data_stored":128040960,"data_compressed":6608160,"data_compressed_allocated":64020480,"data_compressed_original":128040960,"omap_allocated":0,"internal_metadata":0},"log_size":5212,"ondisk_log_size":5212,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63208,"kb_used_data":18328,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94308632,"statfs":{"total":96636764160,"available":96572039168,"internally_reserved":0,"allocated":18767872,"data_stored":37170858,"data_compressed":1914753,"data_compressed_allocated":18550784,"data_compressed_original":37101568,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75508,"kb_used_data":18148,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94296332,"statfs":{"total":96636764160,"available":96559443968,"internally_reserved":0,"allocated":18583552,"data_stored":37269706,"data_compressed":1919386,"data_compressed_allocated":18345984,"data_compressed_original":37183488,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59268,"kb_used_data":14388,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312572,"statfs":{"total":96636764160,"available":96576073728,"internally_reserved":0,"allocated":14733312,"data_stored":29569226,"data_compressed":1522082,"data_compressed_allocated":14495744,"data_compressed_original":29483008,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68472,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303368,"statfs":{"total":96636764160,"available":96566648832,"internally_reserved":0,"allocated":11374592,"data_stored":22859959,"data_compressed":1175811,"data_compressed_allocated":11141120,"data_compressed_original":22773760,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11472896,"data_stored":22945792,"data_compressed":1184267,"data_compressed_allocated":11472896,"data_compressed_original":22945792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":29499392,"data_compressed":1522501,"data_compressed_allocated":14749696,"data_compressed_original":29499392,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18817024,"data_stored":37634048,"data_compressed":1942224,"data_compressed_allocated":18817024,"data_compressed_original":37634048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18980864,"data_stored":37961728,"data_compressed":1959168,"data_compressed_allocated":18980864,"data_compressed_original":37961728,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:42:29.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:30.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:30.041+0000 7f100f2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:30.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:30.047+0000 7f100f2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:30.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 45 16 7726 7710 1.33842 1.35938 0.121142 0.0932713 2024-09-16T07:42:31.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 46 16 7891 7875 1.33735 1.28906 0.121071 0.0933191 2024-09-16T07:42:32.401 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:32.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 47 16 8060 8044 1.33698 1.32031 0.158895 0.0933379 2024-09-16T07:42:32.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:32.539+0000 7fc9b409c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:32.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:32.548+0000 7fc9b409c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:33.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 48 16 8213 8197 1.33403 1.19531 0.0701888 0.0935731 2024-09-16T07:42:34.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 49 16 8377 8361 1.33295 1.28125 0.0533875 0.093652 2024-09-16T07:42:34.486 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:34.486 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:34.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:42:34.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:34.622+0000 7f89b6cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:34.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:34.632+0000 7f89b6cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:34.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:34.880 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:42:34.881 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:42:34.897 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-16T07:42:33.727900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43287091,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5293,"num_write_kb":42804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5267,"ondisk_log_size":5267,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":266456,"kb_used_data":61972,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377220904,"statfs":{"total":386547056640,"available":386274205696,"internally_reserved":0,"allocated":63459328,"data_stored":126869749,"data_compressed":6532032,"data_compressed_allocated":62533632,"data_compressed_original":126541824,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002280"},"pg_stats":[{"pgid":"4.f","version":"25'408","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.061101+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:13.061101+0000","last_peered":"2024-09-16T07:42:13.061101+0000","last_clean":"2024-09-16T07:42:13.061101+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:13.061101+0000","last_undegraded":"2024-09-16T07:42:13.061101+0000","last_fullsized":"2024-09-16T07:42:13.061101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"25'344","reported_seq":356,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.610410+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:14.610410+0000","last_peered":"2024-09-16T07:42:14.610410+0000","last_clean":"2024-09-16T07:42:14.610410+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:14.610410+0000","last_undegraded":"2024-09-16T07:42:14.610410+0000","last_fullsized":"2024-09-16T07:42:14.610410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"25'248","reported_seq":260,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.482957+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:14.482957+0000","last_peered":"2024-09-16T07:42:14.482957+0000","last_clean":"2024-09-16T07:42:14.482957+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:14.482957+0000","last_undegraded":"2024-09-16T07:42:14.482957+0000","last_fullsized":"2024-09-16T07:42:14.482957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"25'328","reported_seq":340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.658516+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:14.658516+0000","last_peered":"2024-09-16T07:42:14.658516+0000","last_clean":"2024-09-16T07:42:14.658516+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:14.658516+0000","last_undegraded":"2024-09-16T07:42:14.658516+0000","last_fullsized":"2024-09-16T07:42:14.658516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"25'298","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.752714+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:14.752714+0000","last_peered":"2024-09-16T07:42:14.752714+0000","last_clean":"2024-09-16T07:42:14.752714+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:14.752714+0000","last_undegraded":"2024-09-16T07:42:14.752714+0000","last_fullsized":"2024-09-16T07:42:14.752714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2441216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"25'376","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.732988+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:14.732988+0000","last_peered":"2024-09-16T07:42:14.732988+0000","last_clean":"2024-09-16T07:42:14.732988+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:14.732988+0000","last_undegraded":"2024-09-16T07:42:14.732988+0000","last_fullsized":"2024-09-16T07:42:14.732988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"25'320","reported_seq":332,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.321549+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:14.321549+0000","last_peered":"2024-09-16T07:42:14.321549+0000","last_clean":"2024-09-16T07:42:14.321549+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:14.321549+0000","last_undegraded":"2024-09-16T07:42:14.321549+0000","last_fullsized":"2024-09-16T07:42:14.321549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"25'296","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.185833+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:14.185833+0000","last_peered":"2024-09-16T07:42:14.185833+0000","last_clean":"2024-09-16T07:42:14.185833+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:14.185833+0000","last_undegraded":"2024-09-16T07:42:14.185833+0000","last_fullsized":"2024-09-16T07:42:14.185833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"25'306","reported_seq":318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.755784+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:14.755784+0000","last_peered":"2024-09-16T07:42:14.755784+0000","last_clean":"2024-09-16T07:42:14.755784+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:14.755784+0000","last_undegraded":"2024-09-16T07:42:14.755784+0000","last_fullsized":"2024-09-16T07:42:14.755784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2506752,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362483+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:41:45.362483+0000","last_peered":"2024-09-16T07:41:45.362483+0000","last_clean":"2024-09-16T07:41:45.362483+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:41:45.362483+0000","last_undegraded":"2024-09-16T07:41:45.362483+0000","last_fullsized":"2024-09-16T07:41:45.362483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.363554+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:41:45.363554+0000","last_peered":"2024-09-16T07:41:45.363554+0000","last_clean":"2024-09-16T07:41:45.363554+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:41:45.363554+0000","last_undegraded":"2024-09-16T07:41:45.363554+0000","last_fullsized":"2024-09-16T07:41:45.363554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'424","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.563276+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:14.563276+0000","last_peered":"2024-09-16T07:42:14.563276+0000","last_clean":"2024-09-16T07:42:14.563276+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:14.563276+0000","last_undegraded":"2024-09-16T07:42:14.563276+0000","last_fullsized":"2024-09-16T07:42:14.563276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.360753+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:41:45.360753+0000","last_peered":"2024-09-16T07:41:45.360753+0000","last_clean":"2024-09-16T07:41:45.360753+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:41:45.360753+0000","last_undegraded":"2024-09-16T07:41:45.360753+0000","last_fullsized":"2024-09-16T07:41:45.360753+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"25'264","reported_seq":276,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.029102+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:14.029102+0000","last_peered":"2024-09-16T07:42:14.029102+0000","last_clean":"2024-09-16T07:42:14.029102+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:14.029102+0000","last_undegraded":"2024-09-16T07:42:14.029102+0000","last_fullsized":"2024-09-16T07:42:14.029102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365844+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:41:45.365844+0000","last_peered":"2024-09-16T07:41:45.365844+0000","last_clean":"2024-09-16T07:41:45.365844+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:41:45.365844+0000","last_undegraded":"2024-09-16T07:41:45.365844+0000","last_fullsized":"2024-09-16T07:41:45.365844+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"25'280","reported_seq":292,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.841873+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:13.841873+0000","last_peered":"2024-09-16T07:42:13.841873+0000","last_clean":"2024-09-16T07:42:13.841873+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:13.841873+0000","last_undegraded":"2024-09-16T07:42:13.841873+0000","last_fullsized":"2024-09-16T07:42:13.841873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365558+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:41:45.365558+0000","last_peered":"2024-09-16T07:41:45.365558+0000","last_clean":"2024-09-16T07:41:45.365558+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:41:45.365558+0000","last_undegraded":"2024-09-16T07:41:45.365558+0000","last_fullsized":"2024-09-16T07:41:45.365558+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"25'336","reported_seq":348,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.489898+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:13.489898+0000","last_peered":"2024-09-16T07:42:13.489898+0000","last_clean":"2024-09-16T07:42:13.489898+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:13.489898+0000","last_undegraded":"2024-09-16T07:42:13.489898+0000","last_fullsized":"2024-09-16T07:42:13.489898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.367923+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:41:45.367923+0000","last_peered":"2024-09-16T07:41:45.367923+0000","last_clean":"2024-09-16T07:41:45.367923+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:41:45.367923+0000","last_undegraded":"2024-09-16T07:41:45.367923+0000","last_fullsized":"2024-09-16T07:41:45.367923+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.768066+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:13.768066+0000","last_peered":"2024-09-16T07:42:13.768066+0000","last_clean":"2024-09-16T07:42:13.768066+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:13.768066+0000","last_undegraded":"2024-09-16T07:42:13.768066+0000","last_fullsized":"2024-09-16T07:42:13.768066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.368368+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:41:45.368368+0000","last_peered":"2024-09-16T07:41:45.368368+0000","last_clean":"2024-09-16T07:41:45.368368+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:41:45.368368+0000","last_undegraded":"2024-09-16T07:41:45.368368+0000","last_fullsized":"2024-09-16T07:41:45.368368+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"25'360","reported_seq":372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.538222+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:14.538222+0000","last_peered":"2024-09-16T07:42:14.538222+0000","last_clean":"2024-09-16T07:42:14.538222+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:14.538222+0000","last_undegraded":"2024-09-16T07:42:14.538222+0000","last_fullsized":"2024-09-16T07:42:14.538222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362929+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:41:45.362929+0000","last_peered":"2024-09-16T07:41:45.362929+0000","last_clean":"2024-09-16T07:41:45.362929+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:41:45.362929+0000","last_undegraded":"2024-09-16T07:41:45.362929+0000","last_fullsized":"2024-09-16T07:41:45.362929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.613352+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:14.613352+0000","last_peered":"2024-09-16T07:42:14.613352+0000","last_clean":"2024-09-16T07:42:14.613352+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:14.613352+0000","last_undegraded":"2024-09-16T07:42:14.613352+0000","last_fullsized":"2024-09-16T07:42:14.613352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.359574+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:41:45.359574+0000","last_peered":"2024-09-16T07:41:45.359574+0000","last_clean":"2024-09-16T07:41:45.359574+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:41:45.359574+0000","last_undegraded":"2024-09-16T07:41:45.359574+0000","last_fullsized":"2024-09-16T07:41:45.359574+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64020480,"data_stored":128040960,"data_compressed":6608160,"data_compressed_allocated":64020480,"data_compressed_original":128040960,"omap_allocated":0,"internal_metadata":0},"log_size":5212,"ondisk_log_size":5212,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63208,"kb_used_data":18328,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94308632,"statfs":{"total":96636764160,"available":96572039168,"internally_reserved":0,"allocated":18767872,"data_stored":37170858,"data_compressed":1914753,"data_compressed_allocated":18550784,"data_compressed_original":37101568,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75508,"kb_used_data":18148,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94296332,"statfs":{"total":96636764160,"available":96559443968,"internally_reserved":0,"allocated":18583552,"data_stored":37269706,"data_compressed":1919386,"data_compressed_allocated":18345984,"data_compressed_original":37183488,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59268,"kb_used_data":14388,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312572,"statfs":{"total":96636764160,"available":96576073728,"internally_reserved":0,"allocated":14733312,"data_stored":29569226,"data_compressed":1522082,"data_compressed_allocated":14495744,"data_compressed_original":29483008,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68472,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303368,"statfs":{"total":96636764160,"available":96566648832,"internally_reserved":0,"allocated":11374592,"data_stored":22859959,"data_compressed":1175811,"data_compressed_allocated":11141120,"data_compressed_original":22773760,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11472896,"data_stored":22945792,"data_compressed":1184267,"data_compressed_allocated":11472896,"data_compressed_original":22945792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":29499392,"data_compressed":1522501,"data_compressed_allocated":14749696,"data_compressed_original":29499392,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18817024,"data_stored":37634048,"data_compressed":1942224,"data_compressed_allocated":18817024,"data_compressed_original":37634048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18980864,"data_stored":37961728,"data_compressed":1959168,"data_compressed_allocated":18980864,"data_compressed_original":37961728,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:42:34.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:34.992+0000 7f9614b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:35.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:35.001+0000 7f9614b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:35.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 50 16 8547 8531 1.33285 1.32812 0.10235 0.0936506 2024-09-16T07:42:36.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 51 16 8698 8682 1.32985 1.17969 0.0805008 0.0938762 2024-09-16T07:42:37.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:37.432 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 52 16 8840 8824 1.3256 1.10938 0.169939 0.0941652 2024-09-16T07:42:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:37.555+0000 7fb70fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:37.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:37.561+0000 7fb70fb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:38.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 53 16 9004 8988 1.32477 1.28125 0.163301 0.0942471 2024-09-16T07:42:39.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 54 16 9162 9146 1.32309 1.23438 0.0808324 0.0943825 2024-09-16T07:42:39.899 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:39.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:42:39.921 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:40.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:40.023+0000 7f45ea551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:40.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:40.037+0000 7f45ea551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:40.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:40.075+0000 7f55de391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:40.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:40.081+0000 7f55de391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:40.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 55 16 9302 9286 1.31892 1.09375 0.0573381 0.0946961 2024-09-16T07:42:40.779 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:42:40.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:42:40.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:40.927+0000 7f7b54f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:40.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:40.941+0000 7f7b54f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:41.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 56 16 9446 9430 1.31545 1.125 0.153149 0.0949157 2024-09-16T07:42:41.784 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:42:41.805 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:42:41.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:41.923+0000 7f5069311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:41.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:41.938+0000 7f5069311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:42.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 57 16 9606 9590 1.3143 1.25 0.0582501 0.0950085 2024-09-16T07:42:42.541 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:42.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:42.657+0000 7f38b7ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:42.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:42.665+0000 7f38b7ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:42.788 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:42:42.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:42:42.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:42.926+0000 7fda1967f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:42.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:42.941+0000 7fda1967f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:43.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 58 16 9726 9710 1.3078 0.9375 0.1211 0.0954668 2024-09-16T07:42:43.792 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:42:43.816 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:42:43.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:42:43.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:43.949+0000 7f83cd948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:43.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:43.962+0000 7f83cd948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:44.232 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:42:44.233 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:42:44.251 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-16T07:42:43.794609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43287091,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5293,"num_write_kb":42804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5267,"ondisk_log_size":5267,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":266456,"kb_used_data":61972,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377220904,"statfs":{"total":386547056640,"available":386274205696,"internally_reserved":0,"allocated":63459328,"data_stored":126869749,"data_compressed":6532032,"data_compressed_allocated":62533632,"data_compressed_original":126541824,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.065588"},"pg_stats":[{"pgid":"4.f","version":"25'408","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.061101+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:13.061101+0000","last_peered":"2024-09-16T07:42:13.061101+0000","last_clean":"2024-09-16T07:42:13.061101+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:13.061101+0000","last_undegraded":"2024-09-16T07:42:13.061101+0000","last_fullsized":"2024-09-16T07:42:13.061101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"25'344","reported_seq":356,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.610410+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:14.610410+0000","last_peered":"2024-09-16T07:42:14.610410+0000","last_clean":"2024-09-16T07:42:14.610410+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:14.610410+0000","last_undegraded":"2024-09-16T07:42:14.610410+0000","last_fullsized":"2024-09-16T07:42:14.610410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"25'248","reported_seq":260,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.482957+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:14.482957+0000","last_peered":"2024-09-16T07:42:14.482957+0000","last_clean":"2024-09-16T07:42:14.482957+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:14.482957+0000","last_undegraded":"2024-09-16T07:42:14.482957+0000","last_fullsized":"2024-09-16T07:42:14.482957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"25'328","reported_seq":340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.658516+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:14.658516+0000","last_peered":"2024-09-16T07:42:14.658516+0000","last_clean":"2024-09-16T07:42:14.658516+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:14.658516+0000","last_undegraded":"2024-09-16T07:42:14.658516+0000","last_fullsized":"2024-09-16T07:42:14.658516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"25'298","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.752714+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:14.752714+0000","last_peered":"2024-09-16T07:42:14.752714+0000","last_clean":"2024-09-16T07:42:14.752714+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:14.752714+0000","last_undegraded":"2024-09-16T07:42:14.752714+0000","last_fullsized":"2024-09-16T07:42:14.752714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2441216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"25'376","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.732988+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:14.732988+0000","last_peered":"2024-09-16T07:42:14.732988+0000","last_clean":"2024-09-16T07:42:14.732988+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:14.732988+0000","last_undegraded":"2024-09-16T07:42:14.732988+0000","last_fullsized":"2024-09-16T07:42:14.732988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"25'320","reported_seq":332,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.321549+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:14.321549+0000","last_peered":"2024-09-16T07:42:14.321549+0000","last_clean":"2024-09-16T07:42:14.321549+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:14.321549+0000","last_undegraded":"2024-09-16T07:42:14.321549+0000","last_fullsized":"2024-09-16T07:42:14.321549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"25'296","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.185833+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:14.185833+0000","last_peered":"2024-09-16T07:42:14.185833+0000","last_clean":"2024-09-16T07:42:14.185833+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:14.185833+0000","last_undegraded":"2024-09-16T07:42:14.185833+0000","last_fullsized":"2024-09-16T07:42:14.185833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"25'306","reported_seq":318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.755784+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:14.755784+0000","last_peered":"2024-09-16T07:42:14.755784+0000","last_clean":"2024-09-16T07:42:14.755784+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:14.755784+0000","last_undegraded":"2024-09-16T07:42:14.755784+0000","last_fullsized":"2024-09-16T07:42:14.755784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2506752,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362483+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:41:45.362483+0000","last_peered":"2024-09-16T07:41:45.362483+0000","last_clean":"2024-09-16T07:41:45.362483+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:41:45.362483+0000","last_undegraded":"2024-09-16T07:41:45.362483+0000","last_fullsized":"2024-09-16T07:41:45.362483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.363554+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:41:45.363554+0000","last_peered":"2024-09-16T07:41:45.363554+0000","last_clean":"2024-09-16T07:41:45.363554+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:41:45.363554+0000","last_undegraded":"2024-09-16T07:41:45.363554+0000","last_fullsized":"2024-09-16T07:41:45.363554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'424","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.563276+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:14.563276+0000","last_peered":"2024-09-16T07:42:14.563276+0000","last_clean":"2024-09-16T07:42:14.563276+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:14.563276+0000","last_undegraded":"2024-09-16T07:42:14.563276+0000","last_fullsized":"2024-09-16T07:42:14.563276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.360753+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:41:45.360753+0000","last_peered":"2024-09-16T07:41:45.360753+0000","last_clean":"2024-09-16T07:41:45.360753+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:41:45.360753+0000","last_undegraded":"2024-09-16T07:41:45.360753+0000","last_fullsized":"2024-09-16T07:41:45.360753+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"25'264","reported_seq":276,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.029102+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:14.029102+0000","last_peered":"2024-09-16T07:42:14.029102+0000","last_clean":"2024-09-16T07:42:14.029102+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:14.029102+0000","last_undegraded":"2024-09-16T07:42:14.029102+0000","last_fullsized":"2024-09-16T07:42:14.029102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365844+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:41:45.365844+0000","last_peered":"2024-09-16T07:41:45.365844+0000","last_clean":"2024-09-16T07:41:45.365844+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:41:45.365844+0000","last_undegraded":"2024-09-16T07:41:45.365844+0000","last_fullsized":"2024-09-16T07:41:45.365844+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"25'280","reported_seq":292,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.841873+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:13.841873+0000","last_peered":"2024-09-16T07:42:13.841873+0000","last_clean":"2024-09-16T07:42:13.841873+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:13.841873+0000","last_undegraded":"2024-09-16T07:42:13.841873+0000","last_fullsized":"2024-09-16T07:42:13.841873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365558+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:41:45.365558+0000","last_peered":"2024-09-16T07:41:45.365558+0000","last_clean":"2024-09-16T07:41:45.365558+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:41:45.365558+0000","last_undegraded":"2024-09-16T07:41:45.365558+0000","last_fullsized":"2024-09-16T07:41:45.365558+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"25'336","reported_seq":348,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.489898+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:13.489898+0000","last_peered":"2024-09-16T07:42:13.489898+0000","last_clean":"2024-09-16T07:42:13.489898+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:13.489898+0000","last_undegraded":"2024-09-16T07:42:13.489898+0000","last_fullsized":"2024-09-16T07:42:13.489898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.367923+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:41:45.367923+0000","last_peered":"2024-09-16T07:41:45.367923+0000","last_clean":"2024-09-16T07:41:45.367923+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:41:45.367923+0000","last_undegraded":"2024-09-16T07:41:45.367923+0000","last_fullsized":"2024-09-16T07:41:45.367923+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.768066+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:13.768066+0000","last_peered":"2024-09-16T07:42:13.768066+0000","last_clean":"2024-09-16T07:42:13.768066+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:13.768066+0000","last_undegraded":"2024-09-16T07:42:13.768066+0000","last_fullsized":"2024-09-16T07:42:13.768066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.368368+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:41:45.368368+0000","last_peered":"2024-09-16T07:41:45.368368+0000","last_clean":"2024-09-16T07:41:45.368368+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:41:45.368368+0000","last_undegraded":"2024-09-16T07:41:45.368368+0000","last_fullsized":"2024-09-16T07:41:45.368368+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"25'360","reported_seq":372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.538222+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:14.538222+0000","last_peered":"2024-09-16T07:42:14.538222+0000","last_clean":"2024-09-16T07:42:14.538222+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:14.538222+0000","last_undegraded":"2024-09-16T07:42:14.538222+0000","last_fullsized":"2024-09-16T07:42:14.538222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362929+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:41:45.362929+0000","last_peered":"2024-09-16T07:41:45.362929+0000","last_clean":"2024-09-16T07:41:45.362929+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:41:45.362929+0000","last_undegraded":"2024-09-16T07:41:45.362929+0000","last_fullsized":"2024-09-16T07:41:45.362929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.613352+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:14.613352+0000","last_peered":"2024-09-16T07:42:14.613352+0000","last_clean":"2024-09-16T07:42:14.613352+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:14.613352+0000","last_undegraded":"2024-09-16T07:42:14.613352+0000","last_fullsized":"2024-09-16T07:42:14.613352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.359574+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:41:45.359574+0000","last_peered":"2024-09-16T07:41:45.359574+0000","last_clean":"2024-09-16T07:41:45.359574+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:41:45.359574+0000","last_undegraded":"2024-09-16T07:41:45.359574+0000","last_fullsized":"2024-09-16T07:41:45.359574+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64020480,"data_stored":128040960,"data_compressed":6608160,"data_compressed_allocated":64020480,"data_compressed_original":128040960,"omap_allocated":0,"internal_metadata":0},"log_size":5212,"ondisk_log_size":5212,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63208,"kb_used_data":18328,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94308632,"statfs":{"total":96636764160,"available":96572039168,"internally_reserved":0,"allocated":18767872,"data_stored":37170858,"data_compressed":1914753,"data_compressed_allocated":18550784,"data_compressed_original":37101568,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75508,"kb_used_data":18148,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94296332,"statfs":{"total":96636764160,"available":96559443968,"internally_reserved":0,"allocated":18583552,"data_stored":37269706,"data_compressed":1919386,"data_compressed_allocated":18345984,"data_compressed_original":37183488,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59268,"kb_used_data":14388,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312572,"statfs":{"total":96636764160,"available":96576073728,"internally_reserved":0,"allocated":14733312,"data_stored":29569226,"data_compressed":1522082,"data_compressed_allocated":14495744,"data_compressed_original":29483008,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68472,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303368,"statfs":{"total":96636764160,"available":96566648832,"internally_reserved":0,"allocated":11374592,"data_stored":22859959,"data_compressed":1175811,"data_compressed_allocated":11141120,"data_compressed_original":22773760,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11472896,"data_stored":22945792,"data_compressed":1184267,"data_compressed_allocated":11472896,"data_compressed_original":22945792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":29499392,"data_compressed":1522501,"data_compressed_allocated":14749696,"data_compressed_original":29499392,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18817024,"data_stored":37634048,"data_compressed":1942224,"data_compressed_allocated":18817024,"data_compressed_original":37634048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18980864,"data_stored":37961728,"data_compressed":1959168,"data_compressed_allocated":18980864,"data_compressed_original":37961728,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:42:44.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:42:44.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:44.379+0000 7f352a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:44.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:44.393+0000 7f352a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:44.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 59 16 9892 9876 1.30762 1.29688 0.0985916 0.0955152 2024-09-16T07:42:44.687 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:42:44.687 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:42:44.699 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-16T07:42:43.794609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43287091,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5293,"num_write_kb":42804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5267,"ondisk_log_size":5267,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":266456,"kb_used_data":61972,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377220904,"statfs":{"total":386547056640,"available":386274205696,"internally_reserved":0,"allocated":63459328,"data_stored":126869749,"data_compressed":6532032,"data_compressed_allocated":62533632,"data_compressed_original":126541824,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.065588"},"pg_stats":[{"pgid":"4.f","version":"25'408","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.061101+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:13.061101+0000","last_peered":"2024-09-16T07:42:13.061101+0000","last_clean":"2024-09-16T07:42:13.061101+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:13.061101+0000","last_undegraded":"2024-09-16T07:42:13.061101+0000","last_fullsized":"2024-09-16T07:42:13.061101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"25'344","reported_seq":356,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.610410+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:14.610410+0000","last_peered":"2024-09-16T07:42:14.610410+0000","last_clean":"2024-09-16T07:42:14.610410+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:14.610410+0000","last_undegraded":"2024-09-16T07:42:14.610410+0000","last_fullsized":"2024-09-16T07:42:14.610410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"25'248","reported_seq":260,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.482957+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:14.482957+0000","last_peered":"2024-09-16T07:42:14.482957+0000","last_clean":"2024-09-16T07:42:14.482957+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:14.482957+0000","last_undegraded":"2024-09-16T07:42:14.482957+0000","last_fullsized":"2024-09-16T07:42:14.482957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"25'328","reported_seq":340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.658516+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:14.658516+0000","last_peered":"2024-09-16T07:42:14.658516+0000","last_clean":"2024-09-16T07:42:14.658516+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:14.658516+0000","last_undegraded":"2024-09-16T07:42:14.658516+0000","last_fullsized":"2024-09-16T07:42:14.658516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"25'298","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.752714+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:14.752714+0000","last_peered":"2024-09-16T07:42:14.752714+0000","last_clean":"2024-09-16T07:42:14.752714+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:14.752714+0000","last_undegraded":"2024-09-16T07:42:14.752714+0000","last_fullsized":"2024-09-16T07:42:14.752714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2441216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"25'376","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.732988+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:14.732988+0000","last_peered":"2024-09-16T07:42:14.732988+0000","last_clean":"2024-09-16T07:42:14.732988+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:14.732988+0000","last_undegraded":"2024-09-16T07:42:14.732988+0000","last_fullsized":"2024-09-16T07:42:14.732988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"25'320","reported_seq":332,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.321549+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:14.321549+0000","last_peered":"2024-09-16T07:42:14.321549+0000","last_clean":"2024-09-16T07:42:14.321549+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:14.321549+0000","last_undegraded":"2024-09-16T07:42:14.321549+0000","last_fullsized":"2024-09-16T07:42:14.321549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"25'296","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.185833+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:14.185833+0000","last_peered":"2024-09-16T07:42:14.185833+0000","last_clean":"2024-09-16T07:42:14.185833+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:14.185833+0000","last_undegraded":"2024-09-16T07:42:14.185833+0000","last_fullsized":"2024-09-16T07:42:14.185833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"25'306","reported_seq":318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.755784+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:14.755784+0000","last_peered":"2024-09-16T07:42:14.755784+0000","last_clean":"2024-09-16T07:42:14.755784+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:14.755784+0000","last_undegraded":"2024-09-16T07:42:14.755784+0000","last_fullsized":"2024-09-16T07:42:14.755784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2506752,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362483+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:41:45.362483+0000","last_peered":"2024-09-16T07:41:45.362483+0000","last_clean":"2024-09-16T07:41:45.362483+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:41:45.362483+0000","last_undegraded":"2024-09-16T07:41:45.362483+0000","last_fullsized":"2024-09-16T07:41:45.362483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.363554+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:41:45.363554+0000","last_peered":"2024-09-16T07:41:45.363554+0000","last_clean":"2024-09-16T07:41:45.363554+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:41:45.363554+0000","last_undegraded":"2024-09-16T07:41:45.363554+0000","last_fullsized":"2024-09-16T07:41:45.363554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'424","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.563276+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:14.563276+0000","last_peered":"2024-09-16T07:42:14.563276+0000","last_clean":"2024-09-16T07:42:14.563276+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:14.563276+0000","last_undegraded":"2024-09-16T07:42:14.563276+0000","last_fullsized":"2024-09-16T07:42:14.563276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.360753+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:41:45.360753+0000","last_peered":"2024-09-16T07:41:45.360753+0000","last_clean":"2024-09-16T07:41:45.360753+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:41:45.360753+0000","last_undegraded":"2024-09-16T07:41:45.360753+0000","last_fullsized":"2024-09-16T07:41:45.360753+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"25'264","reported_seq":276,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.029102+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:14.029102+0000","last_peered":"2024-09-16T07:42:14.029102+0000","last_clean":"2024-09-16T07:42:14.029102+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:14.029102+0000","last_undegraded":"2024-09-16T07:42:14.029102+0000","last_fullsized":"2024-09-16T07:42:14.029102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365844+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:41:45.365844+0000","last_peered":"2024-09-16T07:41:45.365844+0000","last_clean":"2024-09-16T07:41:45.365844+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:41:45.365844+0000","last_undegraded":"2024-09-16T07:41:45.365844+0000","last_fullsized":"2024-09-16T07:41:45.365844+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"25'280","reported_seq":292,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.841873+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:13.841873+0000","last_peered":"2024-09-16T07:42:13.841873+0000","last_clean":"2024-09-16T07:42:13.841873+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:13.841873+0000","last_undegraded":"2024-09-16T07:42:13.841873+0000","last_fullsized":"2024-09-16T07:42:13.841873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365558+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:41:45.365558+0000","last_peered":"2024-09-16T07:41:45.365558+0000","last_clean":"2024-09-16T07:41:45.365558+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:41:45.365558+0000","last_undegraded":"2024-09-16T07:41:45.365558+0000","last_fullsized":"2024-09-16T07:41:45.365558+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"25'336","reported_seq":348,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.489898+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:13.489898+0000","last_peered":"2024-09-16T07:42:13.489898+0000","last_clean":"2024-09-16T07:42:13.489898+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:13.489898+0000","last_undegraded":"2024-09-16T07:42:13.489898+0000","last_fullsized":"2024-09-16T07:42:13.489898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.367923+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:41:45.367923+0000","last_peered":"2024-09-16T07:41:45.367923+0000","last_clean":"2024-09-16T07:41:45.367923+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:41:45.367923+0000","last_undegraded":"2024-09-16T07:41:45.367923+0000","last_fullsized":"2024-09-16T07:41:45.367923+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.768066+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:13.768066+0000","last_peered":"2024-09-16T07:42:13.768066+0000","last_clean":"2024-09-16T07:42:13.768066+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:13.768066+0000","last_undegraded":"2024-09-16T07:42:13.768066+0000","last_fullsized":"2024-09-16T07:42:13.768066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.368368+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:41:45.368368+0000","last_peered":"2024-09-16T07:41:45.368368+0000","last_clean":"2024-09-16T07:41:45.368368+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:41:45.368368+0000","last_undegraded":"2024-09-16T07:41:45.368368+0000","last_fullsized":"2024-09-16T07:41:45.368368+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"25'360","reported_seq":372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.538222+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:14.538222+0000","last_peered":"2024-09-16T07:42:14.538222+0000","last_clean":"2024-09-16T07:42:14.538222+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:14.538222+0000","last_undegraded":"2024-09-16T07:42:14.538222+0000","last_fullsized":"2024-09-16T07:42:14.538222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362929+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:41:45.362929+0000","last_peered":"2024-09-16T07:41:45.362929+0000","last_clean":"2024-09-16T07:41:45.362929+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:41:45.362929+0000","last_undegraded":"2024-09-16T07:41:45.362929+0000","last_fullsized":"2024-09-16T07:41:45.362929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.613352+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:14.613352+0000","last_peered":"2024-09-16T07:42:14.613352+0000","last_clean":"2024-09-16T07:42:14.613352+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:14.613352+0000","last_undegraded":"2024-09-16T07:42:14.613352+0000","last_fullsized":"2024-09-16T07:42:14.613352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.359574+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:41:45.359574+0000","last_peered":"2024-09-16T07:41:45.359574+0000","last_clean":"2024-09-16T07:41:45.359574+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:41:45.359574+0000","last_undegraded":"2024-09-16T07:41:45.359574+0000","last_fullsized":"2024-09-16T07:41:45.359574+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64020480,"data_stored":128040960,"data_compressed":6608160,"data_compressed_allocated":64020480,"data_compressed_original":128040960,"omap_allocated":0,"internal_metadata":0},"log_size":5212,"ondisk_log_size":5212,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63208,"kb_used_data":18328,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94308632,"statfs":{"total":96636764160,"available":96572039168,"internally_reserved":0,"allocated":18767872,"data_stored":37170858,"data_compressed":1914753,"data_compressed_allocated":18550784,"data_compressed_original":37101568,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75508,"kb_used_data":18148,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94296332,"statfs":{"total":96636764160,"available":96559443968,"internally_reserved":0,"allocated":18583552,"data_stored":37269706,"data_compressed":1919386,"data_compressed_allocated":18345984,"data_compressed_original":37183488,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59268,"kb_used_data":14388,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312572,"statfs":{"total":96636764160,"available":96576073728,"internally_reserved":0,"allocated":14733312,"data_stored":29569226,"data_compressed":1522082,"data_compressed_allocated":14495744,"data_compressed_original":29483008,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68472,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303368,"statfs":{"total":96636764160,"available":96566648832,"internally_reserved":0,"allocated":11374592,"data_stored":22859959,"data_compressed":1175811,"data_compressed_allocated":11141120,"data_compressed_original":22773760,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11472896,"data_stored":22945792,"data_compressed":1184267,"data_compressed_allocated":11472896,"data_compressed_original":22945792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":29499392,"data_compressed":1522501,"data_compressed_allocated":14749696,"data_compressed_original":29499392,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18817024,"data_stored":37634048,"data_compressed":1942224,"data_compressed_allocated":18817024,"data_compressed_original":37634048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18980864,"data_stored":37961728,"data_compressed":1959168,"data_compressed_allocated":18980864,"data_compressed_original":37961728,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:42:44.701 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:42:44.701 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:44.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:42:44.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:44.832+0000 7f44042a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:44.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:44.842+0000 7f44042a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:45.105 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:42:45.105 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:42:45.125 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-16T07:42:43.794609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43287091,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5293,"num_write_kb":42804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5267,"ondisk_log_size":5267,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":266456,"kb_used_data":61972,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377220904,"statfs":{"total":386547056640,"available":386274205696,"internally_reserved":0,"allocated":63459328,"data_stored":126869749,"data_compressed":6532032,"data_compressed_allocated":62533632,"data_compressed_original":126541824,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.065588"},"pg_stats":[{"pgid":"4.f","version":"25'408","reported_seq":420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.061101+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:13.061101+0000","last_peered":"2024-09-16T07:42:13.061101+0000","last_clean":"2024-09-16T07:42:13.061101+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:13.061101+0000","last_undegraded":"2024-09-16T07:42:13.061101+0000","last_fullsized":"2024-09-16T07:42:13.061101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"25'344","reported_seq":356,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.610410+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:14.610410+0000","last_peered":"2024-09-16T07:42:14.610410+0000","last_clean":"2024-09-16T07:42:14.610410+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:14.610410+0000","last_undegraded":"2024-09-16T07:42:14.610410+0000","last_fullsized":"2024-09-16T07:42:14.610410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2818048,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":344,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"25'248","reported_seq":260,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.482957+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:14.482957+0000","last_peered":"2024-09-16T07:42:14.482957+0000","last_clean":"2024-09-16T07:42:14.482957+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:14.482957+0000","last_undegraded":"2024-09-16T07:42:14.482957+0000","last_fullsized":"2024-09-16T07:42:14.482957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"25'328","reported_seq":340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.658516+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:14.658516+0000","last_peered":"2024-09-16T07:42:14.658516+0000","last_clean":"2024-09-16T07:42:14.658516+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:14.658516+0000","last_undegraded":"2024-09-16T07:42:14.658516+0000","last_fullsized":"2024-09-16T07:42:14.658516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"25'298","reported_seq":310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.752714+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:14.752714+0000","last_peered":"2024-09-16T07:42:14.752714+0000","last_clean":"2024-09-16T07:42:14.752714+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:14.752714+0000","last_undegraded":"2024-09-16T07:42:14.752714+0000","last_fullsized":"2024-09-16T07:42:14.752714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2441216,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":2384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"25'376","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.732988+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:14.732988+0000","last_peered":"2024-09-16T07:42:14.732988+0000","last_clean":"2024-09-16T07:42:14.732988+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:14.732988+0000","last_undegraded":"2024-09-16T07:42:14.732988+0000","last_fullsized":"2024-09-16T07:42:14.732988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"25'320","reported_seq":332,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.321549+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:14.321549+0000","last_peered":"2024-09-16T07:42:14.321549+0000","last_clean":"2024-09-16T07:42:14.321549+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:14.321549+0000","last_undegraded":"2024-09-16T07:42:14.321549+0000","last_fullsized":"2024-09-16T07:42:14.321549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2621440,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":320,"num_write_kb":2560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"25'296","reported_seq":308,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.185833+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:14.185833+0000","last_peered":"2024-09-16T07:42:14.185833+0000","last_clean":"2024-09-16T07:42:14.185833+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:14.185833+0000","last_undegraded":"2024-09-16T07:42:14.185833+0000","last_fullsized":"2024-09-16T07:42:14.185833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"25'306","reported_seq":318,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.755784+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:14.755784+0000","last_peered":"2024-09-16T07:42:14.755784+0000","last_clean":"2024-09-16T07:42:14.755784+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:14.755784+0000","last_undegraded":"2024-09-16T07:42:14.755784+0000","last_fullsized":"2024-09-16T07:42:14.755784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2506752,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362483+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:41:45.362483+0000","last_peered":"2024-09-16T07:41:45.362483+0000","last_clean":"2024-09-16T07:41:45.362483+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:41:45.362483+0000","last_undegraded":"2024-09-16T07:41:45.362483+0000","last_fullsized":"2024-09-16T07:41:45.362483+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.363554+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:41:45.363554+0000","last_peered":"2024-09-16T07:41:45.363554+0000","last_clean":"2024-09-16T07:41:45.363554+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:41:45.363554+0000","last_undegraded":"2024-09-16T07:41:45.363554+0000","last_fullsized":"2024-09-16T07:41:45.363554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"25'424","reported_seq":436,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.563276+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:14.563276+0000","last_peered":"2024-09-16T07:42:14.563276+0000","last_clean":"2024-09-16T07:42:14.563276+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:14.563276+0000","last_undegraded":"2024-09-16T07:42:14.563276+0000","last_fullsized":"2024-09-16T07:42:14.563276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.360753+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:41:45.360753+0000","last_peered":"2024-09-16T07:41:45.360753+0000","last_clean":"2024-09-16T07:41:45.360753+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:41:45.360753+0000","last_undegraded":"2024-09-16T07:41:45.360753+0000","last_fullsized":"2024-09-16T07:41:45.360753+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"25'264","reported_seq":276,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.029102+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:14.029102+0000","last_peered":"2024-09-16T07:42:14.029102+0000","last_clean":"2024-09-16T07:42:14.029102+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:14.029102+0000","last_undegraded":"2024-09-16T07:42:14.029102+0000","last_fullsized":"2024-09-16T07:42:14.029102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365844+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:41:45.365844+0000","last_peered":"2024-09-16T07:41:45.365844+0000","last_clean":"2024-09-16T07:41:45.365844+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:41:45.365844+0000","last_undegraded":"2024-09-16T07:41:45.365844+0000","last_fullsized":"2024-09-16T07:41:45.365844+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"25'280","reported_seq":292,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.841873+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:13.841873+0000","last_peered":"2024-09-16T07:42:13.841873+0000","last_clean":"2024-09-16T07:42:13.841873+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:13.841873+0000","last_undegraded":"2024-09-16T07:42:13.841873+0000","last_fullsized":"2024-09-16T07:42:13.841873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.365558+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:41:45.365558+0000","last_peered":"2024-09-16T07:41:45.365558+0000","last_clean":"2024-09-16T07:41:45.365558+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:41:45.365558+0000","last_undegraded":"2024-09-16T07:41:45.365558+0000","last_fullsized":"2024-09-16T07:41:45.365558+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"25'336","reported_seq":348,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.489898+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:13.489898+0000","last_peered":"2024-09-16T07:42:13.489898+0000","last_clean":"2024-09-16T07:42:13.489898+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:13.489898+0000","last_undegraded":"2024-09-16T07:42:13.489898+0000","last_fullsized":"2024-09-16T07:42:13.489898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2752512,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":336,"num_write_kb":2688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.367923+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:41:45.367923+0000","last_peered":"2024-09-16T07:41:45.367923+0000","last_clean":"2024-09-16T07:41:45.367923+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:41:45.367923+0000","last_undegraded":"2024-09-16T07:41:45.367923+0000","last_fullsized":"2024-09-16T07:41:45.367923+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:13.768066+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:13.768066+0000","last_peered":"2024-09-16T07:42:13.768066+0000","last_clean":"2024-09-16T07:42:13.768066+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:13.768066+0000","last_undegraded":"2024-09-16T07:42:13.768066+0000","last_fullsized":"2024-09-16T07:42:13.768066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.368368+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:41:45.368368+0000","last_peered":"2024-09-16T07:41:45.368368+0000","last_clean":"2024-09-16T07:41:45.368368+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:41:45.368368+0000","last_undegraded":"2024-09-16T07:41:45.368368+0000","last_fullsized":"2024-09-16T07:41:45.368368+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"25'360","reported_seq":372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.538222+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:14.538222+0000","last_peered":"2024-09-16T07:42:14.538222+0000","last_clean":"2024-09-16T07:42:14.538222+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:14.538222+0000","last_undegraded":"2024-09-16T07:42:14.538222+0000","last_fullsized":"2024-09-16T07:42:14.538222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.362929+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:41:45.362929+0000","last_peered":"2024-09-16T07:41:45.362929+0000","last_clean":"2024-09-16T07:41:45.362929+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:41:45.362929+0000","last_undegraded":"2024-09-16T07:41:45.362929+0000","last_fullsized":"2024-09-16T07:41:45.362929+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"25'312","reported_seq":324,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:42:14.613352+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:14.613352+0000","last_peered":"2024-09-16T07:42:14.613352+0000","last_clean":"2024-09-16T07:42:14.613352+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:14.613352+0000","last_undegraded":"2024-09-16T07:42:14.613352+0000","last_fullsized":"2024-09-16T07:42:14.613352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-16T07:41:45.359574+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:41:45.359574+0000","last_peered":"2024-09-16T07:41:45.359574+0000","last_clean":"2024-09-16T07:41:45.359574+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:41:45.359574+0000","last_undegraded":"2024-09-16T07:41:45.359574+0000","last_fullsized":"2024-09-16T07:41:45.359574+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":42696704,"num_objects":653,"num_object_clones":0,"num_object_copies":1959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5212,"num_write_kb":41696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64020480,"data_stored":128040960,"data_compressed":6608160,"data_compressed_allocated":64020480,"data_compressed_original":128040960,"omap_allocated":0,"internal_metadata":0},"log_size":5212,"ondisk_log_size":5212,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63208,"kb_used_data":18328,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94308632,"statfs":{"total":96636764160,"available":96572039168,"internally_reserved":0,"allocated":18767872,"data_stored":37170858,"data_compressed":1914753,"data_compressed_allocated":18550784,"data_compressed_original":37101568,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75508,"kb_used_data":18148,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94296332,"statfs":{"total":96636764160,"available":96559443968,"internally_reserved":0,"allocated":18583552,"data_stored":37269706,"data_compressed":1919386,"data_compressed_allocated":18345984,"data_compressed_original":37183488,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59268,"kb_used_data":14388,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94312572,"statfs":{"total":96636764160,"available":96576073728,"internally_reserved":0,"allocated":14733312,"data_stored":29569226,"data_compressed":1522082,"data_compressed_allocated":14495744,"data_compressed_original":29483008,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68472,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94303368,"statfs":{"total":96636764160,"available":96566648832,"internally_reserved":0,"allocated":11374592,"data_stored":22859959,"data_compressed":1175811,"data_compressed_allocated":11141120,"data_compressed_original":22773760,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11472896,"data_stored":22945792,"data_compressed":1184267,"data_compressed_allocated":11472896,"data_compressed_original":22945792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":29499392,"data_compressed":1522501,"data_compressed_allocated":14749696,"data_compressed_original":29499392,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18817024,"data_stored":37634048,"data_compressed":1942224,"data_compressed_allocated":18817024,"data_compressed_original":37634048,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18980864,"data_stored":37961728,"data_compressed":1959168,"data_compressed_allocated":18980864,"data_compressed_original":37961728,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:42:45.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:45.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:45.324+0000 7f432e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:45.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:45.331+0000 7f432e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:45.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:42:45.435166+0000 min lat: 0.0166046 max lat: 0.276089 avg lat: 0.0956153 2024-09-16T07:42:45.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:42:45.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 60 16 10043 10027 1.30548 1.17969 0.15949 0.0956153 2024-09-16T07:42:46.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 61 16 10227 10211 1.30765 1.4375 0.0824187 0.0954994 2024-09-16T07:42:47.433 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 62 16 10396 10380 1.30785 1.32031 0.139943 0.0955088 2024-09-16T07:42:47.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:47.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:47.796+0000 7fde36191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:47.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:47.802+0000 7fde36191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:48.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 63 16 10562 10546 1.30767 1.29688 0.0803185 0.0955199 2024-09-16T07:42:49.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 64 16 10704 10688 1.30457 1.10938 0.222846 0.0956243 2024-09-16T07:42:50.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:50.127 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:50.127 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:50.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:42:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:50.255+0000 7fab46b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:50.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:50.261+0000 7fab46b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:50.264+0000 7ff4f3ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:50.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:50.275+0000 7ff4f3ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:50.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 65 16 10854 10838 1.30253 1.17188 0.0401847 0.0958128 2024-09-16T07:42:50.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:42:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:42:50.581 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-09-16T07:42:49.731206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82027059,"num_objects":1247,"num_object_clones":0,"num_object_copies":3741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10022,"num_write_kb":80636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9996,"ondisk_log_size":9996,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331656,"kb_used_data":118852,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377155704,"statfs":{"total":386547056640,"available":386207440896,"internally_reserved":0,"allocated":121704448,"data_stored":243150213,"data_compressed":12533556,"data_compressed_allocated":120647680,"data_compressed_original":242769920,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38739968,"num_objects":590,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4729,"num_write_kb":37832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.945336"},"pg_stats":[{"pgid":"4.f","version":"27'720","reported_seq":744,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.830038+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:43.830038+0000","last_peered":"2024-09-16T07:42:43.830038+0000","last_clean":"2024-09-16T07:42:43.830038+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:43.830038+0000","last_undegraded":"2024-09-16T07:42:43.830038+0000","last_fullsized":"2024-09-16T07:42:43.830038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"29'608","reported_seq":632,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.437505+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:44.437505+0000","last_peered":"2024-09-16T07:42:44.437505+0000","last_clean":"2024-09-16T07:42:44.437505+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:44.437505+0000","last_undegraded":"2024-09-16T07:42:44.437505+0000","last_fullsized":"2024-09-16T07:42:44.437505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.892900+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:43.892900+0000","last_peered":"2024-09-16T07:42:43.892900+0000","last_clean":"2024-09-16T07:42:43.892900+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:43.892900+0000","last_undegraded":"2024-09-16T07:42:43.892900+0000","last_fullsized":"2024-09-16T07:42:43.892900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.647440+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:44.647440+0000","last_peered":"2024-09-16T07:42:44.647440+0000","last_clean":"2024-09-16T07:42:44.647440+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:44.647440+0000","last_undegraded":"2024-09-16T07:42:44.647440+0000","last_fullsized":"2024-09-16T07:42:44.647440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"28'544","reported_seq":568,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.846090+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:43.846090+0000","last_peered":"2024-09-16T07:42:43.846090+0000","last_clean":"2024-09-16T07:42:43.846090+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:43.846090+0000","last_undegraded":"2024-09-16T07:42:43.846090+0000","last_fullsized":"2024-09-16T07:42:43.846090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'768","reported_seq":792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.390241+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:44.390241+0000","last_peered":"2024-09-16T07:42:44.390241+0000","last_clean":"2024-09-16T07:42:44.390241+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:44.390241+0000","last_undegraded":"2024-09-16T07:42:44.390241+0000","last_fullsized":"2024-09-16T07:42:44.390241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'616","reported_seq":640,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.653402+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:44.653402+0000","last_peered":"2024-09-16T07:42:44.653402+0000","last_clean":"2024-09-16T07:42:44.653402+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:44.653402+0000","last_undegraded":"2024-09-16T07:42:44.653402+0000","last_fullsized":"2024-09-16T07:42:44.653402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'661","reported_seq":685,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.752212+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:44.752212+0000","last_peered":"2024-09-16T07:42:44.752212+0000","last_clean":"2024-09-16T07:42:44.752212+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:44.752212+0000","last_undegraded":"2024-09-16T07:42:44.752212+0000","last_fullsized":"2024-09-16T07:42:44.752212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5414912,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":5288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'600","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.544438+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:44.544438+0000","last_peered":"2024-09-16T07:42:44.544438+0000","last_clean":"2024-09-16T07:42:44.544438+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:44.544438+0000","last_undegraded":"2024-09-16T07:42:44.544438+0000","last_fullsized":"2024-09-16T07:42:44.544438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":130,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.826132+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:42:43.826132+0000","last_peered":"2024-09-16T07:42:43.826132+0000","last_clean":"2024-09-16T07:42:43.826132+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:42:43.826132+0000","last_undegraded":"2024-09-16T07:42:43.826132+0000","last_fullsized":"2024-09-16T07:42:43.826132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.815827+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:42:43.815827+0000","last_peered":"2024-09-16T07:42:43.815827+0000","last_clean":"2024-09-16T07:42:43.815827+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:42:43.815827+0000","last_undegraded":"2024-09-16T07:42:43.815827+0000","last_fullsized":"2024-09-16T07:42:43.815827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'664","reported_seq":688,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.188353+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:44.188353+0000","last_peered":"2024-09-16T07:42:44.188353+0000","last_clean":"2024-09-16T07:42:44.188353+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:44.188353+0000","last_undegraded":"2024-09-16T07:42:44.188353+0000","last_fullsized":"2024-09-16T07:42:44.188353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.811004+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:42:43.811004+0000","last_peered":"2024-09-16T07:42:43.811004+0000","last_clean":"2024-09-16T07:42:43.811004+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:42:43.811004+0000","last_undegraded":"2024-09-16T07:42:43.811004+0000","last_fullsized":"2024-09-16T07:42:43.811004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"29'520","reported_seq":544,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.551737+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:44.551737+0000","last_peered":"2024-09-16T07:42:44.551737+0000","last_clean":"2024-09-16T07:42:44.551737+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:44.551737+0000","last_undegraded":"2024-09-16T07:42:44.551737+0000","last_fullsized":"2024-09-16T07:42:44.551737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.845494+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:42:43.845494+0000","last_peered":"2024-09-16T07:42:43.845494+0000","last_clean":"2024-09-16T07:42:43.845494+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:42:43.845494+0000","last_undegraded":"2024-09-16T07:42:43.845494+0000","last_fullsized":"2024-09-16T07:42:43.845494+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"29'632","reported_seq":656,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.343457+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:44.343457+0000","last_peered":"2024-09-16T07:42:44.343457+0000","last_clean":"2024-09-16T07:42:44.343457+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:44.343457+0000","last_undegraded":"2024-09-16T07:42:44.343457+0000","last_fullsized":"2024-09-16T07:42:44.343457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.813297+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:42:43.813297+0000","last_peered":"2024-09-16T07:42:43.813297+0000","last_clean":"2024-09-16T07:42:43.813297+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:42:43.813297+0000","last_undegraded":"2024-09-16T07:42:43.813297+0000","last_fullsized":"2024-09-16T07:42:43.813297+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"27'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.815169+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:43.815169+0000","last_peered":"2024-09-16T07:42:43.815169+0000","last_clean":"2024-09-16T07:42:43.815169+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:43.815169+0000","last_undegraded":"2024-09-16T07:42:43.815169+0000","last_fullsized":"2024-09-16T07:42:43.815169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.828972+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:42:43.828972+0000","last_peered":"2024-09-16T07:42:43.828972+0000","last_clean":"2024-09-16T07:42:43.828972+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:42:43.828972+0000","last_undegraded":"2024-09-16T07:42:43.828972+0000","last_fullsized":"2024-09-16T07:42:43.828972+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'696","reported_seq":720,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.493026+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:44.493026+0000","last_peered":"2024-09-16T07:42:44.493026+0000","last_clean":"2024-09-16T07:42:44.493026+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:44.493026+0000","last_undegraded":"2024-09-16T07:42:44.493026+0000","last_fullsized":"2024-09-16T07:42:44.493026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.832060+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:42:43.832060+0000","last_peered":"2024-09-16T07:42:43.832060+0000","last_clean":"2024-09-16T07:42:43.832060+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:42:43.832060+0000","last_undegraded":"2024-09-16T07:42:43.832060+0000","last_fullsized":"2024-09-16T07:42:43.832060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'584","reported_seq":608,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.719838+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:44.719838+0000","last_peered":"2024-09-16T07:42:44.719838+0000","last_clean":"2024-09-16T07:42:44.719838+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:44.719838+0000","last_undegraded":"2024-09-16T07:42:44.719838+0000","last_fullsized":"2024-09-16T07:42:44.719838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.824960+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:42:43.824960+0000","last_peered":"2024-09-16T07:42:43.824960+0000","last_clean":"2024-09-16T07:42:43.824960+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:42:43.824960+0000","last_undegraded":"2024-09-16T07:42:43.824960+0000","last_fullsized":"2024-09-16T07:42:43.824960+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'600","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.965316+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:43.965316+0000","last_peered":"2024-09-16T07:42:43.965316+0000","last_clean":"2024-09-16T07:42:43.965316+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:43.965316+0000","last_undegraded":"2024-09-16T07:42:43.965316+0000","last_fullsized":"2024-09-16T07:42:43.965316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.808337+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:42:43.808337+0000","last_peered":"2024-09-16T07:42:43.808337+0000","last_clean":"2024-09-16T07:42:43.808337+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:42:43.808337+0000","last_undegraded":"2024-09-16T07:42:43.808337+0000","last_fullsized":"2024-09-16T07:42:43.808337+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":81436672,"num_objects":1243,"num_object_clones":0,"num_object_copies":3729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9941,"num_write_kb":79528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122146816,"data_stored":244293632,"data_compressed":12610953,"data_compressed_allocated":122146816,"data_compressed_original":244293632,"omap_allocated":0,"internal_metadata":0},"log_size":9941,"ondisk_log_size":9941,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79940,"kb_used_data":35060,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94291900,"statfs":{"total":96636764160,"available":96554905600,"internally_reserved":0,"allocated":35901440,"data_stored":71385550,"data_compressed":3680778,"data_compressed_allocated":35651584,"data_compressed_original":71303168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92116,"kb_used_data":34752,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94279724,"statfs":{"total":96636764160,"available":96542437376,"internally_reserved":0,"allocated":35586048,"data_stored":71222254,"data_compressed":3671875,"data_compressed_allocated":35315712,"data_compressed_original":71122944,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84952,"kb_used_data":27592,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94286888,"statfs":{"total":96636764160,"available":96549773312,"internally_reserved":0,"allocated":28254208,"data_stored":56558574,"data_compressed":2915021,"data_compressed_allocated":27983872,"data_compressed_original":56459264,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74648,"kb_used_data":21448,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297192,"statfs":{"total":96636764160,"available":96560324608,"internally_reserved":0,"allocated":21962752,"data_stored":43983835,"data_compressed":2265882,"data_compressed_allocated":21696512,"data_compressed_original":43884544,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21970944,"data_stored":43941888,"data_compressed":2268416,"data_compressed_allocated":21970944,"data_compressed_original":43941888,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28278784,"data_stored":56557568,"data_compressed":2919670,"data_compressed_allocated":28278784,"data_compressed_original":56557568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35766272,"data_stored":71532544,"data_compressed":3692598,"data_compressed_allocated":35766272,"data_compressed_original":71532544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36130816,"data_stored":72261632,"data_compressed":3730269,"data_compressed_allocated":36130816,"data_compressed_original":72261632,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:42:51.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 66 16 11020 11004 1.30244 1.29688 0.108586 0.0958338 2024-09-16T07:42:52.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 67 16 11172 11156 1.30072 1.1875 0.046255 0.0959642 2024-09-16T07:42:52.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:52.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:52.920+0000 7f2b8eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:52.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:52.927+0000 7f2b8eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:53.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 68 16 11303 11287 1.29665 1.02344 0.0755443 0.0963337 2024-09-16T07:42:54.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 69 16 11465 11449 1.29619 1.26562 0.0903764 0.0963697 2024-09-16T07:42:55.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:42:55.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:55.242+0000 7f10f2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:55.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:55.250+0000 7f10f2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:55.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 70 16 11599 11583 1.29263 1.04688 0.127921 0.0966311 2024-09-16T07:42:55.584 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:42:55.584 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:42:55.584 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:42:55.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:42:55.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:55.696+0000 7fdd914d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:55.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:55.707+0000 7fdd914d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:55.725 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:55.726 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:55.726 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:55.728 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:55.728 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:55.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:42:55.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:55.850+0000 7f8b1db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:55.860+0000 7f8b1db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:55.880 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:55.880 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:55.880 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:55.880 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:55.880 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:55.881 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:55.883 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:55.884 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:55.884 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:42:56.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:56.023+0000 7fea6c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:56.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:56.036+0000 7fea6c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:56.204 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:56.205 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:56.209 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:56.209 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:56.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:42:56.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:56.324+0000 7f312cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:56.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:56.338+0000 7f312cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:56.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 71 16 11743 11727 1.29027 1.125 0.0616383 0.096808 2024-09-16T07:42:56.484 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:42:56.484 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:42:56.484 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:42:56.484 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:42:56.484 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:42:56.484 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:42:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:42:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:42:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:42:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:42:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:42:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:42:56.488 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:42:56.488 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:42:57.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 72 16 11883 11867 1.28754 1.09375 0.152493 0.0969862 2024-09-16T07:42:57.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:42:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:57.618+0000 7ff84d6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:42:57.624+0000 7ff84d6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:42:58.434 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 73 16 12036 12020 1.28627 1.19531 0.10276 0.0970495 2024-09-16T07:42:59.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 74 16 12179 12163 1.28399 1.11719 0.102396 0.0972861 2024-09-16T07:42:59.943 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:00.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:00.068+0000 7f7749551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:00.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:00.075+0000 7f7749551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:00.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 75 16 12326 12310 1.28218 1.14844 0.0896229 0.0973812 2024-09-16T07:43:01.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 76 16 12479 12463 1.28103 1.19531 0.14379 0.0974848 2024-09-16T07:43:01.489 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:01.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:43:01.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:01.629+0000 7f73b12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:01.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:01.643+0000 7f73b12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:02.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:02.263 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:43:02.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:43:02.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:02.392+0000 7f6d3c463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:02.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:02.403+0000 7f6d3c463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:02.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 77 16 12639 12623 1.28063 1.25 0.0747651 0.097537 2024-09-16T07:43:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:02.481+0000 7f302b151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:02.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:02.501+0000 7f302b151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:03.264 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:43:03.288 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:43:03.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 78 16 12801 12785 1.28043 1.26562 0.134437 0.0975549 2024-09-16T07:43:03.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:03.436+0000 7fee51711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:03.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:03.449+0000 7fee51711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:04.269 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:43:04.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:43:04.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 79 16 12944 12928 1.27837 1.11719 0.125916 0.0976789 2024-09-16T07:43:04.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:04.437+0000 7fdb44591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:04.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:04.452+0000 7fdb44591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:04.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:04.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:04.959+0000 7f6f33f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:04.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:04.966+0000 7f6f33f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:05.276 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:43:05.296 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:43:05.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:43:05.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:43:05.437038+0000 min lat: 0.0166046 max lat: 0.314354 avg lat: 0.0978934 2024-09-16T07:43:05.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:43:05.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 80 16 13086 13070 1.27625 1.10938 0.0813794 0.0978934 2024-09-16T07:43:05.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:05.484+0000 7f48946d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:05.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:05.493+0000 7f48946d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:05.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:43:05.696 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:43:05.713 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-16T07:43:05.281633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82027059,"num_objects":1247,"num_object_clones":0,"num_object_copies":3741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10022,"num_write_kb":80636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9996,"ondisk_log_size":9996,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331656,"kb_used_data":118852,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377155704,"statfs":{"total":386547056640,"available":386207440896,"internally_reserved":0,"allocated":121704448,"data_stored":243150213,"data_compressed":12533556,"data_compressed_allocated":120647680,"data_compressed_original":242769920,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.548266"},"pg_stats":[{"pgid":"4.f","version":"27'720","reported_seq":744,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.830038+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:43.830038+0000","last_peered":"2024-09-16T07:42:43.830038+0000","last_clean":"2024-09-16T07:42:43.830038+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:43.830038+0000","last_undegraded":"2024-09-16T07:42:43.830038+0000","last_fullsized":"2024-09-16T07:42:43.830038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"29'608","reported_seq":632,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.437505+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:44.437505+0000","last_peered":"2024-09-16T07:42:44.437505+0000","last_clean":"2024-09-16T07:42:44.437505+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:44.437505+0000","last_undegraded":"2024-09-16T07:42:44.437505+0000","last_fullsized":"2024-09-16T07:42:44.437505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.892900+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:43.892900+0000","last_peered":"2024-09-16T07:42:43.892900+0000","last_clean":"2024-09-16T07:42:43.892900+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:43.892900+0000","last_undegraded":"2024-09-16T07:42:43.892900+0000","last_fullsized":"2024-09-16T07:42:43.892900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.647440+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:44.647440+0000","last_peered":"2024-09-16T07:42:44.647440+0000","last_clean":"2024-09-16T07:42:44.647440+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:44.647440+0000","last_undegraded":"2024-09-16T07:42:44.647440+0000","last_fullsized":"2024-09-16T07:42:44.647440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"28'544","reported_seq":568,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.846090+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:43.846090+0000","last_peered":"2024-09-16T07:42:43.846090+0000","last_clean":"2024-09-16T07:42:43.846090+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:43.846090+0000","last_undegraded":"2024-09-16T07:42:43.846090+0000","last_fullsized":"2024-09-16T07:42:43.846090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'768","reported_seq":792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.390241+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:44.390241+0000","last_peered":"2024-09-16T07:42:44.390241+0000","last_clean":"2024-09-16T07:42:44.390241+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:44.390241+0000","last_undegraded":"2024-09-16T07:42:44.390241+0000","last_fullsized":"2024-09-16T07:42:44.390241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'616","reported_seq":640,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.653402+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:44.653402+0000","last_peered":"2024-09-16T07:42:44.653402+0000","last_clean":"2024-09-16T07:42:44.653402+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:44.653402+0000","last_undegraded":"2024-09-16T07:42:44.653402+0000","last_fullsized":"2024-09-16T07:42:44.653402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'661","reported_seq":685,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.752212+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:44.752212+0000","last_peered":"2024-09-16T07:42:44.752212+0000","last_clean":"2024-09-16T07:42:44.752212+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:44.752212+0000","last_undegraded":"2024-09-16T07:42:44.752212+0000","last_fullsized":"2024-09-16T07:42:44.752212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5414912,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":5288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'600","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.544438+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:44.544438+0000","last_peered":"2024-09-16T07:42:44.544438+0000","last_clean":"2024-09-16T07:42:44.544438+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:44.544438+0000","last_undegraded":"2024-09-16T07:42:44.544438+0000","last_fullsized":"2024-09-16T07:42:44.544438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":130,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.826132+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:42:43.826132+0000","last_peered":"2024-09-16T07:42:43.826132+0000","last_clean":"2024-09-16T07:42:43.826132+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:42:43.826132+0000","last_undegraded":"2024-09-16T07:42:43.826132+0000","last_fullsized":"2024-09-16T07:42:43.826132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.815827+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:42:43.815827+0000","last_peered":"2024-09-16T07:42:43.815827+0000","last_clean":"2024-09-16T07:42:43.815827+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:42:43.815827+0000","last_undegraded":"2024-09-16T07:42:43.815827+0000","last_fullsized":"2024-09-16T07:42:43.815827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'664","reported_seq":688,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.188353+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:44.188353+0000","last_peered":"2024-09-16T07:42:44.188353+0000","last_clean":"2024-09-16T07:42:44.188353+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:44.188353+0000","last_undegraded":"2024-09-16T07:42:44.188353+0000","last_fullsized":"2024-09-16T07:42:44.188353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.811004+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:42:43.811004+0000","last_peered":"2024-09-16T07:42:43.811004+0000","last_clean":"2024-09-16T07:42:43.811004+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:42:43.811004+0000","last_undegraded":"2024-09-16T07:42:43.811004+0000","last_fullsized":"2024-09-16T07:42:43.811004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"29'520","reported_seq":544,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.551737+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:44.551737+0000","last_peered":"2024-09-16T07:42:44.551737+0000","last_clean":"2024-09-16T07:42:44.551737+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:44.551737+0000","last_undegraded":"2024-09-16T07:42:44.551737+0000","last_fullsized":"2024-09-16T07:42:44.551737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.845494+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:42:43.845494+0000","last_peered":"2024-09-16T07:42:43.845494+0000","last_clean":"2024-09-16T07:42:43.845494+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:42:43.845494+0000","last_undegraded":"2024-09-16T07:42:43.845494+0000","last_fullsized":"2024-09-16T07:42:43.845494+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"29'632","reported_seq":656,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.343457+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:44.343457+0000","last_peered":"2024-09-16T07:42:44.343457+0000","last_clean":"2024-09-16T07:42:44.343457+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:44.343457+0000","last_undegraded":"2024-09-16T07:42:44.343457+0000","last_fullsized":"2024-09-16T07:42:44.343457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.813297+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:42:43.813297+0000","last_peered":"2024-09-16T07:42:43.813297+0000","last_clean":"2024-09-16T07:42:43.813297+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:42:43.813297+0000","last_undegraded":"2024-09-16T07:42:43.813297+0000","last_fullsized":"2024-09-16T07:42:43.813297+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"27'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.815169+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:43.815169+0000","last_peered":"2024-09-16T07:42:43.815169+0000","last_clean":"2024-09-16T07:42:43.815169+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:43.815169+0000","last_undegraded":"2024-09-16T07:42:43.815169+0000","last_fullsized":"2024-09-16T07:42:43.815169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.828972+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:42:43.828972+0000","last_peered":"2024-09-16T07:42:43.828972+0000","last_clean":"2024-09-16T07:42:43.828972+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:42:43.828972+0000","last_undegraded":"2024-09-16T07:42:43.828972+0000","last_fullsized":"2024-09-16T07:42:43.828972+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'696","reported_seq":720,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.493026+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:44.493026+0000","last_peered":"2024-09-16T07:42:44.493026+0000","last_clean":"2024-09-16T07:42:44.493026+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:44.493026+0000","last_undegraded":"2024-09-16T07:42:44.493026+0000","last_fullsized":"2024-09-16T07:42:44.493026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.832060+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:42:43.832060+0000","last_peered":"2024-09-16T07:42:43.832060+0000","last_clean":"2024-09-16T07:42:43.832060+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:42:43.832060+0000","last_undegraded":"2024-09-16T07:42:43.832060+0000","last_fullsized":"2024-09-16T07:42:43.832060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'584","reported_seq":608,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.719838+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:44.719838+0000","last_peered":"2024-09-16T07:42:44.719838+0000","last_clean":"2024-09-16T07:42:44.719838+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:44.719838+0000","last_undegraded":"2024-09-16T07:42:44.719838+0000","last_fullsized":"2024-09-16T07:42:44.719838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.824960+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:42:43.824960+0000","last_peered":"2024-09-16T07:42:43.824960+0000","last_clean":"2024-09-16T07:42:43.824960+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:42:43.824960+0000","last_undegraded":"2024-09-16T07:42:43.824960+0000","last_fullsized":"2024-09-16T07:42:43.824960+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'600","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.965316+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:43.965316+0000","last_peered":"2024-09-16T07:42:43.965316+0000","last_clean":"2024-09-16T07:42:43.965316+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:43.965316+0000","last_undegraded":"2024-09-16T07:42:43.965316+0000","last_fullsized":"2024-09-16T07:42:43.965316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.808337+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:42:43.808337+0000","last_peered":"2024-09-16T07:42:43.808337+0000","last_clean":"2024-09-16T07:42:43.808337+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:42:43.808337+0000","last_undegraded":"2024-09-16T07:42:43.808337+0000","last_fullsized":"2024-09-16T07:42:43.808337+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":81436672,"num_objects":1243,"num_object_clones":0,"num_object_copies":3729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9941,"num_write_kb":79528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122146816,"data_stored":244293632,"data_compressed":12610953,"data_compressed_allocated":122146816,"data_compressed_original":244293632,"omap_allocated":0,"internal_metadata":0},"log_size":9941,"ondisk_log_size":9941,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79940,"kb_used_data":35060,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94291900,"statfs":{"total":96636764160,"available":96554905600,"internally_reserved":0,"allocated":35901440,"data_stored":71385550,"data_compressed":3680778,"data_compressed_allocated":35651584,"data_compressed_original":71303168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92116,"kb_used_data":34752,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94279724,"statfs":{"total":96636764160,"available":96542437376,"internally_reserved":0,"allocated":35586048,"data_stored":71222254,"data_compressed":3671875,"data_compressed_allocated":35315712,"data_compressed_original":71122944,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84952,"kb_used_data":27592,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94286888,"statfs":{"total":96636764160,"available":96549773312,"internally_reserved":0,"allocated":28254208,"data_stored":56558574,"data_compressed":2915021,"data_compressed_allocated":27983872,"data_compressed_original":56459264,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74648,"kb_used_data":21448,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297192,"statfs":{"total":96636764160,"available":96560324608,"internally_reserved":0,"allocated":21962752,"data_stored":43983835,"data_compressed":2265882,"data_compressed_allocated":21696512,"data_compressed_original":43884544,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21970944,"data_stored":43941888,"data_compressed":2268416,"data_compressed_allocated":21970944,"data_compressed_original":43941888,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28278784,"data_stored":56557568,"data_compressed":2919670,"data_compressed_allocated":28278784,"data_compressed_original":56557568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35766272,"data_stored":71532544,"data_compressed":3692598,"data_compressed_allocated":35766272,"data_compressed_original":71532544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36130816,"data_stored":72261632,"data_compressed":3730269,"data_compressed_allocated":36130816,"data_compressed_original":72261632,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:43:05.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:43:05.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:05.859+0000 7fe7cb0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:05.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:05.871+0000 7fe7cb0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:06.172 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:43:06.172 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:43:06.195 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-09-16T07:43:05.734503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82027059,"num_objects":1247,"num_object_clones":0,"num_object_copies":3741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10022,"num_write_kb":80636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9996,"ondisk_log_size":9996,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331656,"kb_used_data":118852,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377155704,"statfs":{"total":386547056640,"available":386207440896,"internally_reserved":0,"allocated":121704448,"data_stored":243150213,"data_compressed":12533556,"data_compressed_allocated":120647680,"data_compressed_original":242769920,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000796"},"pg_stats":[{"pgid":"4.f","version":"27'720","reported_seq":744,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.830038+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:43.830038+0000","last_peered":"2024-09-16T07:42:43.830038+0000","last_clean":"2024-09-16T07:42:43.830038+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:43.830038+0000","last_undegraded":"2024-09-16T07:42:43.830038+0000","last_fullsized":"2024-09-16T07:42:43.830038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"29'608","reported_seq":632,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.437505+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:44.437505+0000","last_peered":"2024-09-16T07:42:44.437505+0000","last_clean":"2024-09-16T07:42:44.437505+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:44.437505+0000","last_undegraded":"2024-09-16T07:42:44.437505+0000","last_fullsized":"2024-09-16T07:42:44.437505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.892900+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:43.892900+0000","last_peered":"2024-09-16T07:42:43.892900+0000","last_clean":"2024-09-16T07:42:43.892900+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:43.892900+0000","last_undegraded":"2024-09-16T07:42:43.892900+0000","last_fullsized":"2024-09-16T07:42:43.892900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.647440+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:44.647440+0000","last_peered":"2024-09-16T07:42:44.647440+0000","last_clean":"2024-09-16T07:42:44.647440+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:44.647440+0000","last_undegraded":"2024-09-16T07:42:44.647440+0000","last_fullsized":"2024-09-16T07:42:44.647440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"28'544","reported_seq":568,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.846090+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:43.846090+0000","last_peered":"2024-09-16T07:42:43.846090+0000","last_clean":"2024-09-16T07:42:43.846090+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:43.846090+0000","last_undegraded":"2024-09-16T07:42:43.846090+0000","last_fullsized":"2024-09-16T07:42:43.846090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'768","reported_seq":792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.390241+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:44.390241+0000","last_peered":"2024-09-16T07:42:44.390241+0000","last_clean":"2024-09-16T07:42:44.390241+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:44.390241+0000","last_undegraded":"2024-09-16T07:42:44.390241+0000","last_fullsized":"2024-09-16T07:42:44.390241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'616","reported_seq":640,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.653402+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:44.653402+0000","last_peered":"2024-09-16T07:42:44.653402+0000","last_clean":"2024-09-16T07:42:44.653402+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:44.653402+0000","last_undegraded":"2024-09-16T07:42:44.653402+0000","last_fullsized":"2024-09-16T07:42:44.653402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'661","reported_seq":685,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.752212+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:44.752212+0000","last_peered":"2024-09-16T07:42:44.752212+0000","last_clean":"2024-09-16T07:42:44.752212+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:44.752212+0000","last_undegraded":"2024-09-16T07:42:44.752212+0000","last_fullsized":"2024-09-16T07:42:44.752212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5414912,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":5288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'600","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.544438+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:44.544438+0000","last_peered":"2024-09-16T07:42:44.544438+0000","last_clean":"2024-09-16T07:42:44.544438+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:44.544438+0000","last_undegraded":"2024-09-16T07:42:44.544438+0000","last_fullsized":"2024-09-16T07:42:44.544438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":130,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.826132+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:42:43.826132+0000","last_peered":"2024-09-16T07:42:43.826132+0000","last_clean":"2024-09-16T07:42:43.826132+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:42:43.826132+0000","last_undegraded":"2024-09-16T07:42:43.826132+0000","last_fullsized":"2024-09-16T07:42:43.826132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.815827+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:42:43.815827+0000","last_peered":"2024-09-16T07:42:43.815827+0000","last_clean":"2024-09-16T07:42:43.815827+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:42:43.815827+0000","last_undegraded":"2024-09-16T07:42:43.815827+0000","last_fullsized":"2024-09-16T07:42:43.815827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'664","reported_seq":688,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.188353+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:44.188353+0000","last_peered":"2024-09-16T07:42:44.188353+0000","last_clean":"2024-09-16T07:42:44.188353+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:44.188353+0000","last_undegraded":"2024-09-16T07:42:44.188353+0000","last_fullsized":"2024-09-16T07:42:44.188353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.811004+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:42:43.811004+0000","last_peered":"2024-09-16T07:42:43.811004+0000","last_clean":"2024-09-16T07:42:43.811004+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:42:43.811004+0000","last_undegraded":"2024-09-16T07:42:43.811004+0000","last_fullsized":"2024-09-16T07:42:43.811004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"29'520","reported_seq":544,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.551737+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:44.551737+0000","last_peered":"2024-09-16T07:42:44.551737+0000","last_clean":"2024-09-16T07:42:44.551737+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:44.551737+0000","last_undegraded":"2024-09-16T07:42:44.551737+0000","last_fullsized":"2024-09-16T07:42:44.551737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.845494+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:42:43.845494+0000","last_peered":"2024-09-16T07:42:43.845494+0000","last_clean":"2024-09-16T07:42:43.845494+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:42:43.845494+0000","last_undegraded":"2024-09-16T07:42:43.845494+0000","last_fullsized":"2024-09-16T07:42:43.845494+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"29'632","reported_seq":656,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.343457+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:44.343457+0000","last_peered":"2024-09-16T07:42:44.343457+0000","last_clean":"2024-09-16T07:42:44.343457+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:44.343457+0000","last_undegraded":"2024-09-16T07:42:44.343457+0000","last_fullsized":"2024-09-16T07:42:44.343457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.813297+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:42:43.813297+0000","last_peered":"2024-09-16T07:42:43.813297+0000","last_clean":"2024-09-16T07:42:43.813297+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:42:43.813297+0000","last_undegraded":"2024-09-16T07:42:43.813297+0000","last_fullsized":"2024-09-16T07:42:43.813297+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"27'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.815169+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:43.815169+0000","last_peered":"2024-09-16T07:42:43.815169+0000","last_clean":"2024-09-16T07:42:43.815169+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:43.815169+0000","last_undegraded":"2024-09-16T07:42:43.815169+0000","last_fullsized":"2024-09-16T07:42:43.815169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.828972+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:42:43.828972+0000","last_peered":"2024-09-16T07:42:43.828972+0000","last_clean":"2024-09-16T07:42:43.828972+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:42:43.828972+0000","last_undegraded":"2024-09-16T07:42:43.828972+0000","last_fullsized":"2024-09-16T07:42:43.828972+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'696","reported_seq":720,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.493026+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:44.493026+0000","last_peered":"2024-09-16T07:42:44.493026+0000","last_clean":"2024-09-16T07:42:44.493026+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:44.493026+0000","last_undegraded":"2024-09-16T07:42:44.493026+0000","last_fullsized":"2024-09-16T07:42:44.493026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.832060+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:42:43.832060+0000","last_peered":"2024-09-16T07:42:43.832060+0000","last_clean":"2024-09-16T07:42:43.832060+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:42:43.832060+0000","last_undegraded":"2024-09-16T07:42:43.832060+0000","last_fullsized":"2024-09-16T07:42:43.832060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'584","reported_seq":608,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.719838+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:44.719838+0000","last_peered":"2024-09-16T07:42:44.719838+0000","last_clean":"2024-09-16T07:42:44.719838+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:44.719838+0000","last_undegraded":"2024-09-16T07:42:44.719838+0000","last_fullsized":"2024-09-16T07:42:44.719838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.824960+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:42:43.824960+0000","last_peered":"2024-09-16T07:42:43.824960+0000","last_clean":"2024-09-16T07:42:43.824960+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:42:43.824960+0000","last_undegraded":"2024-09-16T07:42:43.824960+0000","last_fullsized":"2024-09-16T07:42:43.824960+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'600","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.965316+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:43.965316+0000","last_peered":"2024-09-16T07:42:43.965316+0000","last_clean":"2024-09-16T07:42:43.965316+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:43.965316+0000","last_undegraded":"2024-09-16T07:42:43.965316+0000","last_fullsized":"2024-09-16T07:42:43.965316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.808337+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:42:43.808337+0000","last_peered":"2024-09-16T07:42:43.808337+0000","last_clean":"2024-09-16T07:42:43.808337+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:42:43.808337+0000","last_undegraded":"2024-09-16T07:42:43.808337+0000","last_fullsized":"2024-09-16T07:42:43.808337+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":81436672,"num_objects":1243,"num_object_clones":0,"num_object_copies":3729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9941,"num_write_kb":79528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122146816,"data_stored":244293632,"data_compressed":12610953,"data_compressed_allocated":122146816,"data_compressed_original":244293632,"omap_allocated":0,"internal_metadata":0},"log_size":9941,"ondisk_log_size":9941,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79940,"kb_used_data":35060,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94291900,"statfs":{"total":96636764160,"available":96554905600,"internally_reserved":0,"allocated":35901440,"data_stored":71385550,"data_compressed":3680778,"data_compressed_allocated":35651584,"data_compressed_original":71303168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92116,"kb_used_data":34752,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94279724,"statfs":{"total":96636764160,"available":96542437376,"internally_reserved":0,"allocated":35586048,"data_stored":71222254,"data_compressed":3671875,"data_compressed_allocated":35315712,"data_compressed_original":71122944,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84952,"kb_used_data":27592,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94286888,"statfs":{"total":96636764160,"available":96549773312,"internally_reserved":0,"allocated":28254208,"data_stored":56558574,"data_compressed":2915021,"data_compressed_allocated":27983872,"data_compressed_original":56459264,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74648,"kb_used_data":21448,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297192,"statfs":{"total":96636764160,"available":96560324608,"internally_reserved":0,"allocated":21962752,"data_stored":43983835,"data_compressed":2265882,"data_compressed_allocated":21696512,"data_compressed_original":43884544,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21970944,"data_stored":43941888,"data_compressed":2268416,"data_compressed_allocated":21970944,"data_compressed_original":43941888,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28278784,"data_stored":56557568,"data_compressed":2919670,"data_compressed_allocated":28278784,"data_compressed_original":56557568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35766272,"data_stored":71532544,"data_compressed":3692598,"data_compressed_allocated":35766272,"data_compressed_original":71532544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36130816,"data_stored":72261632,"data_compressed":3730269,"data_compressed_allocated":36130816,"data_compressed_original":72261632,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:43:06.197 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:43:06.197 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:06.197 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:43:06.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:06.326+0000 7f4357751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:06.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:06.336+0000 7f4357751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:06.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 81 16 13223 13207 1.27371 1.07031 0.101106 0.098046 2024-09-16T07:43:06.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:43:06.567 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:43:06.583 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-09-16T07:43:05.734503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82027059,"num_objects":1247,"num_object_clones":0,"num_object_copies":3741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10022,"num_write_kb":80636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9996,"ondisk_log_size":9996,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331656,"kb_used_data":118852,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":377155704,"statfs":{"total":386547056640,"available":386207440896,"internally_reserved":0,"allocated":121704448,"data_stored":243150213,"data_compressed":12533556,"data_compressed_allocated":120647680,"data_compressed_original":242769920,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000796"},"pg_stats":[{"pgid":"4.f","version":"27'720","reported_seq":744,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.830038+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:42:43.830038+0000","last_peered":"2024-09-16T07:42:43.830038+0000","last_clean":"2024-09-16T07:42:43.830038+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:42:43.830038+0000","last_undegraded":"2024-09-16T07:42:43.830038+0000","last_fullsized":"2024-09-16T07:42:43.830038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"29'608","reported_seq":632,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.437505+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:42:44.437505+0000","last_peered":"2024-09-16T07:42:44.437505+0000","last_clean":"2024-09-16T07:42:44.437505+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:42:44.437505+0000","last_undegraded":"2024-09-16T07:42:44.437505+0000","last_fullsized":"2024-09-16T07:42:44.437505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.892900+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:42:43.892900+0000","last_peered":"2024-09-16T07:42:43.892900+0000","last_clean":"2024-09-16T07:42:43.892900+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:42:43.892900+0000","last_undegraded":"2024-09-16T07:42:43.892900+0000","last_fullsized":"2024-09-16T07:42:43.892900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.647440+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:42:44.647440+0000","last_peered":"2024-09-16T07:42:44.647440+0000","last_clean":"2024-09-16T07:42:44.647440+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:42:44.647440+0000","last_undegraded":"2024-09-16T07:42:44.647440+0000","last_fullsized":"2024-09-16T07:42:44.647440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"28'544","reported_seq":568,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.846090+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:42:43.846090+0000","last_peered":"2024-09-16T07:42:43.846090+0000","last_clean":"2024-09-16T07:42:43.846090+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:42:43.846090+0000","last_undegraded":"2024-09-16T07:42:43.846090+0000","last_fullsized":"2024-09-16T07:42:43.846090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'768","reported_seq":792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.390241+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:42:44.390241+0000","last_peered":"2024-09-16T07:42:44.390241+0000","last_clean":"2024-09-16T07:42:44.390241+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:42:44.390241+0000","last_undegraded":"2024-09-16T07:42:44.390241+0000","last_fullsized":"2024-09-16T07:42:44.390241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'616","reported_seq":640,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.653402+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:42:44.653402+0000","last_peered":"2024-09-16T07:42:44.653402+0000","last_clean":"2024-09-16T07:42:44.653402+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:42:44.653402+0000","last_undegraded":"2024-09-16T07:42:44.653402+0000","last_fullsized":"2024-09-16T07:42:44.653402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'661","reported_seq":685,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.752212+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:42:44.752212+0000","last_peered":"2024-09-16T07:42:44.752212+0000","last_clean":"2024-09-16T07:42:44.752212+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:42:44.752212+0000","last_undegraded":"2024-09-16T07:42:44.752212+0000","last_fullsized":"2024-09-16T07:42:44.752212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5414912,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":5288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'600","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.544438+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:42:44.544438+0000","last_peered":"2024-09-16T07:42:44.544438+0000","last_clean":"2024-09-16T07:42:44.544438+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:42:44.544438+0000","last_undegraded":"2024-09-16T07:42:44.544438+0000","last_fullsized":"2024-09-16T07:42:44.544438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":130,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.826132+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:42:43.826132+0000","last_peered":"2024-09-16T07:42:43.826132+0000","last_clean":"2024-09-16T07:42:43.826132+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:42:43.826132+0000","last_undegraded":"2024-09-16T07:42:43.826132+0000","last_fullsized":"2024-09-16T07:42:43.826132+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.815827+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:42:43.815827+0000","last_peered":"2024-09-16T07:42:43.815827+0000","last_clean":"2024-09-16T07:42:43.815827+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:42:43.815827+0000","last_undegraded":"2024-09-16T07:42:43.815827+0000","last_fullsized":"2024-09-16T07:42:43.815827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'664","reported_seq":688,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.188353+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:42:44.188353+0000","last_peered":"2024-09-16T07:42:44.188353+0000","last_clean":"2024-09-16T07:42:44.188353+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:42:44.188353+0000","last_undegraded":"2024-09-16T07:42:44.188353+0000","last_fullsized":"2024-09-16T07:42:44.188353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.811004+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:42:43.811004+0000","last_peered":"2024-09-16T07:42:43.811004+0000","last_clean":"2024-09-16T07:42:43.811004+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:42:43.811004+0000","last_undegraded":"2024-09-16T07:42:43.811004+0000","last_fullsized":"2024-09-16T07:42:43.811004+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"29'520","reported_seq":544,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.551737+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:42:44.551737+0000","last_peered":"2024-09-16T07:42:44.551737+0000","last_clean":"2024-09-16T07:42:44.551737+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:42:44.551737+0000","last_undegraded":"2024-09-16T07:42:44.551737+0000","last_fullsized":"2024-09-16T07:42:44.551737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4259840,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":520,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.845494+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:42:43.845494+0000","last_peered":"2024-09-16T07:42:43.845494+0000","last_clean":"2024-09-16T07:42:43.845494+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:42:43.845494+0000","last_undegraded":"2024-09-16T07:42:43.845494+0000","last_fullsized":"2024-09-16T07:42:43.845494+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"29'632","reported_seq":656,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.343457+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:42:44.343457+0000","last_peered":"2024-09-16T07:42:44.343457+0000","last_clean":"2024-09-16T07:42:44.343457+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:42:44.343457+0000","last_undegraded":"2024-09-16T07:42:44.343457+0000","last_fullsized":"2024-09-16T07:42:44.343457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.813297+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:42:43.813297+0000","last_peered":"2024-09-16T07:42:43.813297+0000","last_clean":"2024-09-16T07:42:43.813297+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:42:43.813297+0000","last_undegraded":"2024-09-16T07:42:43.813297+0000","last_fullsized":"2024-09-16T07:42:43.813297+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"27'576","reported_seq":600,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.815169+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:42:43.815169+0000","last_peered":"2024-09-16T07:42:43.815169+0000","last_clean":"2024-09-16T07:42:43.815169+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:42:43.815169+0000","last_undegraded":"2024-09-16T07:42:43.815169+0000","last_fullsized":"2024-09-16T07:42:43.815169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.828972+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:42:43.828972+0000","last_peered":"2024-09-16T07:42:43.828972+0000","last_clean":"2024-09-16T07:42:43.828972+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:42:43.828972+0000","last_undegraded":"2024-09-16T07:42:43.828972+0000","last_fullsized":"2024-09-16T07:42:43.828972+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'696","reported_seq":720,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.493026+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:42:44.493026+0000","last_peered":"2024-09-16T07:42:44.493026+0000","last_clean":"2024-09-16T07:42:44.493026+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:42:44.493026+0000","last_undegraded":"2024-09-16T07:42:44.493026+0000","last_fullsized":"2024-09-16T07:42:44.493026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.832060+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:42:43.832060+0000","last_peered":"2024-09-16T07:42:43.832060+0000","last_clean":"2024-09-16T07:42:43.832060+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:42:43.832060+0000","last_undegraded":"2024-09-16T07:42:43.832060+0000","last_fullsized":"2024-09-16T07:42:43.832060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'584","reported_seq":608,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:44.719838+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:42:44.719838+0000","last_peered":"2024-09-16T07:42:44.719838+0000","last_clean":"2024-09-16T07:42:44.719838+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:42:44.719838+0000","last_undegraded":"2024-09-16T07:42:44.719838+0000","last_fullsized":"2024-09-16T07:42:44.719838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.824960+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:42:43.824960+0000","last_peered":"2024-09-16T07:42:43.824960+0000","last_clean":"2024-09-16T07:42:43.824960+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:42:43.824960+0000","last_undegraded":"2024-09-16T07:42:43.824960+0000","last_fullsized":"2024-09-16T07:42:43.824960+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'600","reported_seq":624,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.965316+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:42:43.965316+0000","last_peered":"2024-09-16T07:42:43.965316+0000","last_clean":"2024-09-16T07:42:43.965316+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:42:43.965316+0000","last_undegraded":"2024-09-16T07:42:43.965316+0000","last_fullsized":"2024-09-16T07:42:43.965316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-16T07:42:43.808337+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:42:43.808337+0000","last_peered":"2024-09-16T07:42:43.808337+0000","last_clean":"2024-09-16T07:42:43.808337+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:42:43.808337+0000","last_undegraded":"2024-09-16T07:42:43.808337+0000","last_fullsized":"2024-09-16T07:42:43.808337+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":81436672,"num_objects":1243,"num_object_clones":0,"num_object_copies":3729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9941,"num_write_kb":79528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122146816,"data_stored":244293632,"data_compressed":12610953,"data_compressed_allocated":122146816,"data_compressed_original":244293632,"omap_allocated":0,"internal_metadata":0},"log_size":9941,"ondisk_log_size":9941,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79940,"kb_used_data":35060,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94291900,"statfs":{"total":96636764160,"available":96554905600,"internally_reserved":0,"allocated":35901440,"data_stored":71385550,"data_compressed":3680778,"data_compressed_allocated":35651584,"data_compressed_original":71303168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92116,"kb_used_data":34752,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94279724,"statfs":{"total":96636764160,"available":96542437376,"internally_reserved":0,"allocated":35586048,"data_stored":71222254,"data_compressed":3671875,"data_compressed_allocated":35315712,"data_compressed_original":71122944,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84952,"kb_used_data":27592,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94286888,"statfs":{"total":96636764160,"available":96549773312,"internally_reserved":0,"allocated":28254208,"data_stored":56558574,"data_compressed":2915021,"data_compressed_allocated":27983872,"data_compressed_original":56459264,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74648,"kb_used_data":21448,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297192,"statfs":{"total":96636764160,"available":96560324608,"internally_reserved":0,"allocated":21962752,"data_stored":43983835,"data_compressed":2265882,"data_compressed_allocated":21696512,"data_compressed_original":43884544,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21970944,"data_stored":43941888,"data_compressed":2268416,"data_compressed_allocated":21970944,"data_compressed_original":43941888,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28278784,"data_stored":56557568,"data_compressed":2919670,"data_compressed_allocated":28278784,"data_compressed_original":56557568,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35766272,"data_stored":71532544,"data_compressed":3692598,"data_compressed_allocated":35766272,"data_compressed_original":71532544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36130816,"data_stored":72261632,"data_compressed":3730269,"data_compressed_allocated":36130816,"data_compressed_original":72261632,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:43:07.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:07.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:07.396+0000 7f7196b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:07.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:07.402+0000 7f7196b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:07.435 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 82 16 13372 13356 1.27237 1.16406 0.0771377 0.0981867 2024-09-16T07:43:08.437 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 83 16 13512 13496 1.27022 1.09375 0.0607973 0.0983437 2024-09-16T07:43:09.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 84 16 13649 13633 1.26784 1.07031 0.134481 0.0984756 2024-09-16T07:43:09.874 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:10.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:10.032+0000 7fe739111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:10.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:10.039+0000 7fe739111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:10.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 85 16 13801 13785 1.26689 1.1875 0.0890184 0.0985939 2024-09-16T07:43:11.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 86 16 13941 13925 1.26488 1.09375 0.0934248 0.0987323 2024-09-16T07:43:11.585 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:11.585 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:11.585 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:43:11.586 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:43:11.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:11.704+0000 7f4d53791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:11.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:11.718+0000 7f4d53791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:11.739 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:11.739 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:11.739 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:11.740 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:11.742 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:11.742 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:11.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:43:11.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:11.870+0000 7f44f1674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:11.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:11.881+0000 7f44f1674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:11.900 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:11.901 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:11.904 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:11.904 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:11.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:43:12.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:12.063+0000 7f1757391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:12.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:12.076+0000 7f1757391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:12.096 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:12.097 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:12.101 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:12.101 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:12.102 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:43:12.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:12.258+0000 7feb5fe7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:12.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:12.271+0000 7feb5fe7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:12.310 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:12.310 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:12.310 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:12.310 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:12.310 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:12.311 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:12.311 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:12.311 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:12.311 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:12.311 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:12.311 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:12.311 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:12.315 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:12.315 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:12.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 87 16 14089 14073 1.26363 1.15625 0.126105 0.0988233 2024-09-16T07:43:12.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:12.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:12.580+0000 7f1c2a2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:12.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:12.588+0000 7f1c2a2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:13.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 88 16 14232 14216 1.26196 1.11719 0.0693947 0.0989835 2024-09-16T07:43:14.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 89 16 14379 14363 1.26068 1.14844 0.0666642 0.0990748 2024-09-16T07:43:14.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:15.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:15.108+0000 7f75acb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:15.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:15.114+0000 7f75acb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:15.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 90 15 14527 14512 1.25961 1.16406 0.0440607 0.099153 2024-09-16T07:43:16.436 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total time run: 90.0948 2024-09-16T07:43:16.437 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total writes made: 14527 2024-09-16T07:43:16.439 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Write size: 8192 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object size: 65536 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Bandwidth (MB/sec): 1.2597 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Bandwidth: 0.126236 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max bandwidth (MB/sec): 1.60938 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min bandwidth (MB/sec): 0.9375 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average IOPS: 161 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev IOPS: 16.1581 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max IOPS: 206 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min IOPS: 120 2024-09-16T07:43:16.440 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average Latency(s): 0.0991909 2024-09-16T07:43:16.441 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Latency(s): 0.0396645 2024-09-16T07:43:16.441 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max latency(s): 0.314354 2024-09-16T07:43:16.441 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min latency(s): 0.0166046 2024-09-16T07:43:16.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:43:17.316 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:17.316 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:17.316 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:43:17.316 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:43:17.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:17.460+0000 7f63fed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:17.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:17.474+0000 7f63fed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:17.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:17.496 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:17.497 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:17.497 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:17.497 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:17.500 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:17.500 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:17.500 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:43:17.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:17.606+0000 7f32a9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:17.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:17.613+0000 7f32a9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:17.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:17.680+0000 7fda58391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:17.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:17.691+0000 7fda58391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:17.849 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:17.849 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:17.849 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:17.849 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:17.850 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:17.850 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:17.850 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:17.850 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:17.850 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:17.850 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:17.850 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:17.850 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:17.853 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:17.854 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:17.854 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:43:18.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:18.005+0000 7f473ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:18.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:18.020+0000 7f473ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:18.189 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:18.189 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:18.189 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:18.189 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:18.190 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:18.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:18.194 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:18.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:43:18.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:18.339+0000 7fdc4b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:18.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:18.351+0000 7fdc4b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:18.381 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:18.385 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:18.385 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:20.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:20.404+0000 7f9f3fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:20.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:20.414+0000 7f9f3fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:22.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:23.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:23.021+0000 7f3e7c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:23.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:23.027+0000 7f3e7c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:23.386 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:23.386 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:23.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:43:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:23.534+0000 7f362bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:23.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:23.544+0000 7f362bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:23.791 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:43:23.792 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:43:23.811 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-16T07:43:23.738105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":118727219,"num_objects":1807,"num_object_clones":0,"num_object_copies":5421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14502,"num_write_kb":116476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14476,"ondisk_log_size":14476,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":369212,"kb_used_data":173052,"kb_used_omap":0,"kb_used_meta":196096,"kb_avail":377118148,"statfs":{"total":386547056640,"available":386168983552,"internally_reserved":0,"allocated":177205248,"data_stored":353942037,"data_compressed":18251667,"data_compressed_allocated":176017408,"data_compressed_original":353509376,"omap_allocated":0,"internal_metadata":200802304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4480,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002451"},"pg_stats":[{"pgid":"4.f","version":"33'1024","reported_seq":1060,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.360346+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:43:14.360346+0000","last_peered":"2024-09-16T07:43:14.360346+0000","last_clean":"2024-09-16T07:43:14.360346+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:43:14.360346+0000","last_undegraded":"2024-09-16T07:43:14.360346+0000","last_fullsized":"2024-09-16T07:43:14.360346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'904","reported_seq":940,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.428881+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:43:14.428881+0000","last_peered":"2024-09-16T07:43:14.428881+0000","last_clean":"2024-09-16T07:43:14.428881+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:43:14.428881+0000","last_undegraded":"2024-09-16T07:43:14.428881+0000","last_fullsized":"2024-09-16T07:43:14.428881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'845","reported_seq":881,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.743130+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:43:14.743130+0000","last_peered":"2024-09-16T07:43:14.743130+0000","last_clean":"2024-09-16T07:43:14.743130+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:43:14.743130+0000","last_undegraded":"2024-09-16T07:43:14.743130+0000","last_fullsized":"2024-09-16T07:43:14.743130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6922240,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":6760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"33'856","reported_seq":892,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.693663+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:43:14.693663+0000","last_peered":"2024-09-16T07:43:14.693663+0000","last_clean":"2024-09-16T07:43:14.693663+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:43:14.693663+0000","last_undegraded":"2024-09-16T07:43:14.693663+0000","last_fullsized":"2024-09-16T07:43:14.693663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'800","reported_seq":836,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.035557+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:43:14.035557+0000","last_peered":"2024-09-16T07:43:14.035557+0000","last_clean":"2024-09-16T07:43:14.035557+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:43:14.035557+0000","last_undegraded":"2024-09-16T07:43:14.035557+0000","last_fullsized":"2024-09-16T07:43:14.035557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'1040","reported_seq":1076,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.199712+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:43:14.199712+0000","last_peered":"2024-09-16T07:43:14.199712+0000","last_clean":"2024-09-16T07:43:14.199712+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:43:14.199712+0000","last_undegraded":"2024-09-16T07:43:14.199712+0000","last_fullsized":"2024-09-16T07:43:14.199712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'912","reported_seq":948,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.650217+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:43:14.650217+0000","last_peered":"2024-09-16T07:43:14.650217+0000","last_clean":"2024-09-16T07:43:14.650217+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:43:14.650217+0000","last_undegraded":"2024-09-16T07:43:14.650217+0000","last_fullsized":"2024-09-16T07:43:14.650217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'936","reported_seq":972,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:12.809361+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:43:12.809361+0000","last_peered":"2024-09-16T07:43:12.809361+0000","last_clean":"2024-09-16T07:43:12.809361+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:43:12.809361+0000","last_undegraded":"2024-09-16T07:43:12.809361+0000","last_fullsized":"2024-09-16T07:43:12.809361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"33'936","reported_seq":972,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.517556+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:43:14.517556+0000","last_peered":"2024-09-16T07:43:14.517556+0000","last_clean":"2024-09-16T07:43:14.517556+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:43:14.517556+0000","last_undegraded":"2024-09-16T07:43:14.517556+0000","last_fullsized":"2024-09-16T07:43:14.517556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.303250+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:43:05.303250+0000","last_peered":"2024-09-16T07:43:05.303250+0000","last_clean":"2024-09-16T07:43:05.303250+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:43:05.303250+0000","last_undegraded":"2024-09-16T07:43:05.303250+0000","last_fullsized":"2024-09-16T07:43:05.303250+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.333725+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:43:05.333725+0000","last_peered":"2024-09-16T07:43:05.333725+0000","last_clean":"2024-09-16T07:43:05.333725+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:43:05.333725+0000","last_undegraded":"2024-09-16T07:43:05.333725+0000","last_fullsized":"2024-09-16T07:43:05.333725+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'976","reported_seq":1012,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.557281+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:43:14.557281+0000","last_peered":"2024-09-16T07:43:14.557281+0000","last_clean":"2024-09-16T07:43:14.557281+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:43:14.557281+0000","last_undegraded":"2024-09-16T07:43:14.557281+0000","last_fullsized":"2024-09-16T07:43:14.557281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.314374+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:43:05.314374+0000","last_peered":"2024-09-16T07:43:05.314374+0000","last_clean":"2024-09-16T07:43:05.314374+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:43:05.314374+0000","last_undegraded":"2024-09-16T07:43:05.314374+0000","last_fullsized":"2024-09-16T07:43:05.314374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"33'808","reported_seq":844,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:13.047337+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:43:13.047337+0000","last_peered":"2024-09-16T07:43:13.047337+0000","last_clean":"2024-09-16T07:43:13.047337+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:43:13.047337+0000","last_undegraded":"2024-09-16T07:43:13.047337+0000","last_fullsized":"2024-09-16T07:43:13.047337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.326232+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:43:05.326232+0000","last_peered":"2024-09-16T07:43:05.326232+0000","last_clean":"2024-09-16T07:43:05.326232+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:43:05.326232+0000","last_undegraded":"2024-09-16T07:43:05.326232+0000","last_fullsized":"2024-09-16T07:43:05.326232+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"33'912","reported_seq":948,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.119056+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:43:14.119056+0000","last_peered":"2024-09-16T07:43:14.119056+0000","last_clean":"2024-09-16T07:43:14.119056+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:43:14.119056+0000","last_undegraded":"2024-09-16T07:43:14.119056+0000","last_fullsized":"2024-09-16T07:43:14.119056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.325050+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:43:05.325050+0000","last_peered":"2024-09-16T07:43:05.325050+0000","last_clean":"2024-09-16T07:43:05.325050+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:43:05.325050+0000","last_undegraded":"2024-09-16T07:43:05.325050+0000","last_fullsized":"2024-09-16T07:43:05.325050+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"33'840","reported_seq":876,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:13.907873+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:43:13.907873+0000","last_peered":"2024-09-16T07:43:13.907873+0000","last_clean":"2024-09-16T07:43:13.907873+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:43:13.907873+0000","last_undegraded":"2024-09-16T07:43:13.907873+0000","last_fullsized":"2024-09-16T07:43:13.907873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.320103+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:43:05.320103+0000","last_peered":"2024-09-16T07:43:05.320103+0000","last_clean":"2024-09-16T07:43:05.320103+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:43:05.320103+0000","last_undegraded":"2024-09-16T07:43:05.320103+0000","last_fullsized":"2024-09-16T07:43:05.320103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"33'920","reported_seq":956,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:13.501125+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:43:13.501125+0000","last_peered":"2024-09-16T07:43:13.501125+0000","last_clean":"2024-09-16T07:43:13.501125+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:43:13.501125+0000","last_undegraded":"2024-09-16T07:43:13.501125+0000","last_fullsized":"2024-09-16T07:43:13.501125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.318915+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:43:05.318915+0000","last_peered":"2024-09-16T07:43:05.318915+0000","last_clean":"2024-09-16T07:43:05.318915+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:43:05.318915+0000","last_undegraded":"2024-09-16T07:43:05.318915+0000","last_fullsized":"2024-09-16T07:43:05.318915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'856","reported_seq":892,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.266841+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:43:14.266841+0000","last_peered":"2024-09-16T07:43:14.266841+0000","last_clean":"2024-09-16T07:43:14.266841+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:43:14.266841+0000","last_undegraded":"2024-09-16T07:43:14.266841+0000","last_fullsized":"2024-09-16T07:43:14.266841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.301609+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:43:05.301609+0000","last_peered":"2024-09-16T07:43:05.301609+0000","last_clean":"2024-09-16T07:43:05.301609+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:43:05.301609+0000","last_undegraded":"2024-09-16T07:43:05.301609+0000","last_fullsized":"2024-09-16T07:43:05.301609+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'856","reported_seq":892,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:13.805643+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:43:13.805643+0000","last_peered":"2024-09-16T07:43:13.805643+0000","last_clean":"2024-09-16T07:43:13.805643+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:43:13.805643+0000","last_undegraded":"2024-09-16T07:43:13.805643+0000","last_fullsized":"2024-09-16T07:43:13.805643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.319128+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:43:05.319128+0000","last_peered":"2024-09-16T07:43:05.319128+0000","last_clean":"2024-09-16T07:43:05.319128+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:43:05.319128+0000","last_undegraded":"2024-09-16T07:43:05.319128+0000","last_fullsized":"2024-09-16T07:43:05.319128+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":118136832,"num_objects":1803,"num_object_clones":0,"num_object_copies":5409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14421,"num_write_kb":115368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177201152,"data_stored":354402304,"data_compressed":18296493,"data_compressed_allocated":177201152,"data_compressed_original":354402304,"omap_allocated":0,"internal_metadata":0},"log_size":14421,"ondisk_log_size":14421,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95764,"kb_used_data":50884,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":52105216,"data_stored":103740658,"data_compressed":5350781,"data_compressed_allocated":51822592,"data_compressed_original":103645184,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103840,"kb_used_data":50640,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94268000,"statfs":{"total":96636764160,"available":96530432000,"internally_reserved":0,"allocated":51855360,"data_stored":103708434,"data_compressed":5348646,"data_compressed_allocated":51552256,"data_compressed_original":103596032,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92972,"kb_used_data":39772,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94278868,"statfs":{"total":96636764160,"available":96541560832,"internally_reserved":0,"allocated":40726528,"data_stored":81450770,"data_compressed":4199671,"data_compressed_allocated":40423424,"data_compressed_original":81338368,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76636,"kb_used_data":31756,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94295204,"statfs":{"total":96636764160,"available":96558288896,"internally_reserved":0,"allocated":32518144,"data_stored":65042175,"data_compressed":3352569,"data_compressed_allocated":32219136,"data_compressed_original":64929792,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32407552,"data_stored":64815104,"data_compressed":3346220,"data_compressed_allocated":32407552,"data_compressed_original":64815104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40648704,"data_stored":81297408,"data_compressed":4197129,"data_compressed_allocated":40648704,"data_compressed_original":81297408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51888128,"data_stored":103776256,"data_compressed":5357525,"data_compressed_allocated":51888128,"data_compressed_original":103776256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52256768,"data_stored":104513536,"data_compressed":5395619,"data_compressed_allocated":52256768,"data_compressed_original":104513536,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:43:25.600 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:25.745+0000 7fae96abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:25.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:25.753+0000 7fae96abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:26.944 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Removed 1816 objects 2024-09-16T07:43:26.944 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Clean up completed and total clean up time :10.4799 2024-09-16T07:43:28.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:28.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:28.252+0000 7ff47ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:28.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:28.257+0000 7ff47ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:28.814 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:28.814 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:28.814 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:43:28.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:28.920+0000 7fd57306c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:28.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:28.928+0000 7fd57306c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:29.090 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-09-16T07:43:29.090 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-09-16T07:43:29.114 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:43:29.115 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:43:29.127 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-16T07:43:27.738853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":118727219,"num_objects":1807,"num_object_clones":0,"num_object_copies":5421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14502,"num_write_kb":116476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14476,"ondisk_log_size":14476,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":369212,"kb_used_data":173052,"kb_used_omap":0,"kb_used_meta":196096,"kb_avail":377118148,"statfs":{"total":386547056640,"available":386168983552,"internally_reserved":0,"allocated":177205248,"data_stored":353942037,"data_compressed":18251667,"data_compressed_allocated":176017408,"data_compressed_original":353509376,"omap_allocated":0,"internal_metadata":200802304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002499"},"pg_stats":[{"pgid":"4.f","version":"33'1024","reported_seq":1060,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.360346+0000","last_change":"2024-09-16T07:41:44.505146+0000","last_active":"2024-09-16T07:43:14.360346+0000","last_peered":"2024-09-16T07:43:14.360346+0000","last_clean":"2024-09-16T07:43:14.360346+0000","last_became_active":"2024-09-16T07:41:44.498062+0000","last_became_peered":"2024-09-16T07:41:44.498062+0000","last_unstale":"2024-09-16T07:43:14.360346+0000","last_undegraded":"2024-09-16T07:43:14.360346+0000","last_fullsized":"2024-09-16T07:43:14.360346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":128,"num_object_clones":0,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'904","reported_seq":940,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.428881+0000","last_change":"2024-09-16T07:41:44.494260+0000","last_active":"2024-09-16T07:43:14.428881+0000","last_peered":"2024-09-16T07:43:14.428881+0000","last_clean":"2024-09-16T07:43:14.428881+0000","last_became_active":"2024-09-16T07:41:44.483466+0000","last_became_peered":"2024-09-16T07:41:44.483466+0000","last_unstale":"2024-09-16T07:43:14.428881+0000","last_undegraded":"2024-09-16T07:43:14.428881+0000","last_fullsized":"2024-09-16T07:43:14.428881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7405568,"num_objects":113,"num_object_clones":0,"num_object_copies":339,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":904,"num_write_kb":7232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'845","reported_seq":881,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.743130+0000","last_change":"2024-09-16T07:41:44.561952+0000","last_active":"2024-09-16T07:43:14.743130+0000","last_peered":"2024-09-16T07:43:14.743130+0000","last_clean":"2024-09-16T07:43:14.743130+0000","last_became_active":"2024-09-16T07:41:44.544651+0000","last_became_peered":"2024-09-16T07:41:44.544651+0000","last_unstale":"2024-09-16T07:43:14.743130+0000","last_undegraded":"2024-09-16T07:43:14.743130+0000","last_fullsized":"2024-09-16T07:43:14.743130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6922240,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":845,"num_write_kb":6760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"33'856","reported_seq":892,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.693663+0000","last_change":"2024-09-16T07:41:44.456100+0000","last_active":"2024-09-16T07:43:14.693663+0000","last_peered":"2024-09-16T07:43:14.693663+0000","last_clean":"2024-09-16T07:43:14.693663+0000","last_became_active":"2024-09-16T07:41:44.449683+0000","last_became_peered":"2024-09-16T07:41:44.449683+0000","last_unstale":"2024-09-16T07:43:14.693663+0000","last_undegraded":"2024-09-16T07:43:14.693663+0000","last_fullsized":"2024-09-16T07:43:14.693663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'800","reported_seq":836,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.035557+0000","last_change":"2024-09-16T07:41:44.523040+0000","last_active":"2024-09-16T07:43:14.035557+0000","last_peered":"2024-09-16T07:43:14.035557+0000","last_clean":"2024-09-16T07:43:14.035557+0000","last_became_active":"2024-09-16T07:41:44.512808+0000","last_became_peered":"2024-09-16T07:41:44.512808+0000","last_unstale":"2024-09-16T07:43:14.035557+0000","last_undegraded":"2024-09-16T07:43:14.035557+0000","last_fullsized":"2024-09-16T07:43:14.035557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'1040","reported_seq":1076,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.199712+0000","last_change":"2024-09-16T07:41:44.506059+0000","last_active":"2024-09-16T07:43:14.199712+0000","last_peered":"2024-09-16T07:43:14.199712+0000","last_clean":"2024-09-16T07:43:14.199712+0000","last_became_active":"2024-09-16T07:41:44.490508+0000","last_became_peered":"2024-09-16T07:41:44.490508+0000","last_unstale":"2024-09-16T07:43:14.199712+0000","last_undegraded":"2024-09-16T07:43:14.199712+0000","last_fullsized":"2024-09-16T07:43:14.199712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8519680,"num_objects":130,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1040,"num_write_kb":8320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'912","reported_seq":948,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.650217+0000","last_change":"2024-09-16T07:41:44.495259+0000","last_active":"2024-09-16T07:43:14.650217+0000","last_peered":"2024-09-16T07:43:14.650217+0000","last_clean":"2024-09-16T07:43:14.650217+0000","last_became_active":"2024-09-16T07:41:44.485155+0000","last_became_peered":"2024-09-16T07:41:44.485155+0000","last_unstale":"2024-09-16T07:43:14.650217+0000","last_undegraded":"2024-09-16T07:43:14.650217+0000","last_fullsized":"2024-09-16T07:43:14.650217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'936","reported_seq":972,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:12.809361+0000","last_change":"2024-09-16T07:41:44.481670+0000","last_active":"2024-09-16T07:43:12.809361+0000","last_peered":"2024-09-16T07:43:12.809361+0000","last_clean":"2024-09-16T07:43:12.809361+0000","last_became_active":"2024-09-16T07:41:44.472312+0000","last_became_peered":"2024-09-16T07:41:44.472312+0000","last_unstale":"2024-09-16T07:43:12.809361+0000","last_undegraded":"2024-09-16T07:43:12.809361+0000","last_fullsized":"2024-09-16T07:43:12.809361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"33'936","reported_seq":972,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.517556+0000","last_change":"2024-09-16T07:41:44.518635+0000","last_active":"2024-09-16T07:43:14.517556+0000","last_peered":"2024-09-16T07:43:14.517556+0000","last_clean":"2024-09-16T07:43:14.517556+0000","last_became_active":"2024-09-16T07:41:44.507823+0000","last_became_peered":"2024-09-16T07:41:44.507823+0000","last_unstale":"2024-09-16T07:43:14.517556+0000","last_undegraded":"2024-09-16T07:43:14.517556+0000","last_fullsized":"2024-09-16T07:43:14.517556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.303250+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:43:05.303250+0000","last_peered":"2024-09-16T07:43:05.303250+0000","last_clean":"2024-09-16T07:43:05.303250+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:43:05.303250+0000","last_undegraded":"2024-09-16T07:43:05.303250+0000","last_fullsized":"2024-09-16T07:43:05.303250+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.333725+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:43:05.333725+0000","last_peered":"2024-09-16T07:43:05.333725+0000","last_clean":"2024-09-16T07:43:05.333725+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:43:05.333725+0000","last_undegraded":"2024-09-16T07:43:05.333725+0000","last_fullsized":"2024-09-16T07:43:05.333725+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'976","reported_seq":1012,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.557281+0000","last_change":"2024-09-16T07:41:44.513265+0000","last_active":"2024-09-16T07:43:14.557281+0000","last_peered":"2024-09-16T07:43:14.557281+0000","last_clean":"2024-09-16T07:43:14.557281+0000","last_became_active":"2024-09-16T07:41:44.506099+0000","last_became_peered":"2024-09-16T07:41:44.506099+0000","last_unstale":"2024-09-16T07:43:14.557281+0000","last_undegraded":"2024-09-16T07:43:14.557281+0000","last_fullsized":"2024-09-16T07:43:14.557281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.314374+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:43:05.314374+0000","last_peered":"2024-09-16T07:43:05.314374+0000","last_clean":"2024-09-16T07:43:05.314374+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:43:05.314374+0000","last_undegraded":"2024-09-16T07:43:05.314374+0000","last_fullsized":"2024-09-16T07:43:05.314374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"33'808","reported_seq":844,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:13.047337+0000","last_change":"2024-09-16T07:41:44.487770+0000","last_active":"2024-09-16T07:43:13.047337+0000","last_peered":"2024-09-16T07:43:13.047337+0000","last_clean":"2024-09-16T07:43:13.047337+0000","last_became_active":"2024-09-16T07:41:44.473028+0000","last_became_peered":"2024-09-16T07:41:44.473028+0000","last_unstale":"2024-09-16T07:43:13.047337+0000","last_undegraded":"2024-09-16T07:43:13.047337+0000","last_fullsized":"2024-09-16T07:43:13.047337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.326232+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:43:05.326232+0000","last_peered":"2024-09-16T07:43:05.326232+0000","last_clean":"2024-09-16T07:43:05.326232+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:43:05.326232+0000","last_undegraded":"2024-09-16T07:43:05.326232+0000","last_fullsized":"2024-09-16T07:43:05.326232+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"33'912","reported_seq":948,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.119056+0000","last_change":"2024-09-16T07:41:44.454988+0000","last_active":"2024-09-16T07:43:14.119056+0000","last_peered":"2024-09-16T07:43:14.119056+0000","last_clean":"2024-09-16T07:43:14.119056+0000","last_became_active":"2024-09-16T07:41:44.439435+0000","last_became_peered":"2024-09-16T07:41:44.439435+0000","last_unstale":"2024-09-16T07:43:14.119056+0000","last_undegraded":"2024-09-16T07:43:14.119056+0000","last_fullsized":"2024-09-16T07:43:14.119056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.325050+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:43:05.325050+0000","last_peered":"2024-09-16T07:43:05.325050+0000","last_clean":"2024-09-16T07:43:05.325050+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:43:05.325050+0000","last_undegraded":"2024-09-16T07:43:05.325050+0000","last_fullsized":"2024-09-16T07:43:05.325050+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"33'840","reported_seq":876,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:13.907873+0000","last_change":"2024-09-16T07:41:44.458192+0000","last_active":"2024-09-16T07:43:13.907873+0000","last_peered":"2024-09-16T07:43:13.907873+0000","last_clean":"2024-09-16T07:43:13.907873+0000","last_became_active":"2024-09-16T07:41:44.447082+0000","last_became_peered":"2024-09-16T07:41:44.447082+0000","last_unstale":"2024-09-16T07:43:13.907873+0000","last_undegraded":"2024-09-16T07:43:13.907873+0000","last_fullsized":"2024-09-16T07:43:13.907873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6881280,"num_objects":105,"num_object_clones":0,"num_object_copies":315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":840,"num_write_kb":6720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.320103+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:43:05.320103+0000","last_peered":"2024-09-16T07:43:05.320103+0000","last_clean":"2024-09-16T07:43:05.320103+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:43:05.320103+0000","last_undegraded":"2024-09-16T07:43:05.320103+0000","last_fullsized":"2024-09-16T07:43:05.320103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"33'920","reported_seq":956,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:13.501125+0000","last_change":"2024-09-16T07:41:44.535500+0000","last_active":"2024-09-16T07:43:13.501125+0000","last_peered":"2024-09-16T07:43:13.501125+0000","last_clean":"2024-09-16T07:43:13.501125+0000","last_became_active":"2024-09-16T07:41:44.528569+0000","last_became_peered":"2024-09-16T07:41:44.528569+0000","last_unstale":"2024-09-16T07:43:13.501125+0000","last_undegraded":"2024-09-16T07:43:13.501125+0000","last_fullsized":"2024-09-16T07:43:13.501125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7536640,"num_objects":115,"num_object_clones":0,"num_object_copies":345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":7360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.318915+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:43:05.318915+0000","last_peered":"2024-09-16T07:43:05.318915+0000","last_clean":"2024-09-16T07:43:05.318915+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:43:05.318915+0000","last_undegraded":"2024-09-16T07:43:05.318915+0000","last_fullsized":"2024-09-16T07:43:05.318915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'856","reported_seq":892,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:14.266841+0000","last_change":"2024-09-16T07:41:44.566603+0000","last_active":"2024-09-16T07:43:14.266841+0000","last_peered":"2024-09-16T07:43:14.266841+0000","last_clean":"2024-09-16T07:43:14.266841+0000","last_became_active":"2024-09-16T07:41:44.552319+0000","last_became_peered":"2024-09-16T07:41:44.552319+0000","last_unstale":"2024-09-16T07:43:14.266841+0000","last_undegraded":"2024-09-16T07:43:14.266841+0000","last_fullsized":"2024-09-16T07:43:14.266841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.301609+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:43:05.301609+0000","last_peered":"2024-09-16T07:43:05.301609+0000","last_clean":"2024-09-16T07:43:05.301609+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:43:05.301609+0000","last_undegraded":"2024-09-16T07:43:05.301609+0000","last_fullsized":"2024-09-16T07:43:05.301609+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'856","reported_seq":892,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:13.805643+0000","last_change":"2024-09-16T07:41:44.498487+0000","last_active":"2024-09-16T07:43:13.805643+0000","last_peered":"2024-09-16T07:43:13.805643+0000","last_clean":"2024-09-16T07:43:13.805643+0000","last_became_active":"2024-09-16T07:41:44.484941+0000","last_became_peered":"2024-09-16T07:41:44.484941+0000","last_unstale":"2024-09-16T07:43:13.805643+0000","last_undegraded":"2024-09-16T07:43:13.805643+0000","last_fullsized":"2024-09-16T07:43:13.805643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:41:43.327884+0000","last_clean_scrub_stamp":"2024-09-16T07:41:43.327884+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.319128+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:43:05.319128+0000","last_peered":"2024-09-16T07:43:05.319128+0000","last_clean":"2024-09-16T07:43:05.319128+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:43:05.319128+0000","last_undegraded":"2024-09-16T07:43:05.319128+0000","last_fullsized":"2024-09-16T07:43:05.319128+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":118136832,"num_objects":1803,"num_object_clones":0,"num_object_copies":5409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14421,"num_write_kb":115368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177201152,"data_stored":354402304,"data_compressed":18296493,"data_compressed_allocated":177201152,"data_compressed_original":354402304,"omap_allocated":0,"internal_metadata":0},"log_size":14421,"ondisk_log_size":14421,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95764,"kb_used_data":50884,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":52105216,"data_stored":103740658,"data_compressed":5350781,"data_compressed_allocated":51822592,"data_compressed_original":103645184,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103840,"kb_used_data":50640,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94268000,"statfs":{"total":96636764160,"available":96530432000,"internally_reserved":0,"allocated":51855360,"data_stored":103708434,"data_compressed":5348646,"data_compressed_allocated":51552256,"data_compressed_original":103596032,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92972,"kb_used_data":39772,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94278868,"statfs":{"total":96636764160,"available":96541560832,"internally_reserved":0,"allocated":40726528,"data_stored":81450770,"data_compressed":4199671,"data_compressed_allocated":40423424,"data_compressed_original":81338368,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76636,"kb_used_data":31756,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94295204,"statfs":{"total":96636764160,"available":96558288896,"internally_reserved":0,"allocated":32518144,"data_stored":65042175,"data_compressed":3352569,"data_compressed_allocated":32219136,"data_compressed_original":64929792,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32407552,"data_stored":64815104,"data_compressed":3346220,"data_compressed_allocated":32407552,"data_compressed_original":64815104,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40648704,"data_stored":81297408,"data_compressed":4197129,"data_compressed_allocated":40648704,"data_compressed_original":81297408,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51888128,"data_stored":103776256,"data_compressed":5357525,"data_compressed_allocated":51888128,"data_compressed_original":103776256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":52256768,"data_stored":104513536,"data_compressed":5395619,"data_compressed_allocated":52256768,"data_compressed_original":104513536,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:43:29.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:29.197+0000 7fd7a46d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:29.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:29.210+0000 7fd7a46d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:30.273 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_1' removed 2024-09-16T07:43:30.298 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:43:30.299 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:43:30.299 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-09-16T07:43:30.299 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-09-16T07:43:30.359 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:30.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:30.451+0000 7f2fbbca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:30.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:30.475+0000 7f2fbbca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:30.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:30.512+0000 7fb0c9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:30.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:30.524+0000 7fb0c9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:31.277 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_2' created 2024-09-16T07:43:31.299 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-09-16T07:43:31.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:31.427+0000 7fdde4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:31.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:31.441+0000 7fdde4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:32.281 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-09-16T07:43:32.668 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:32.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:32.773+0000 7f848da9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:32.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:32.779+0000 7f848da9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:33.300 DEBUG:teuthology.orchestra.run.smithi137:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-09-16T07:43:33.303 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:43:33.303 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:43:33.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:hints = 1 2024-09-16T07:43:33.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:43:33.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object prefix: benchmark_data_smithi137_39002 2024-09-16T07:43:33.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:43:33.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:43:34.129 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:34.130 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:34.130 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:43:34.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:43:34.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:34.272+0000 7f006167f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:34.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:34.284+0000 7f006167f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:34.312 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:34.312 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:34.312 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:34.312 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:34.312 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:34.313 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:34.313 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:34.313 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:34.313 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:34.313 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:34.313 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:34.313 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:34.316 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:34.316 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:34.316 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:43:34.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 1 16 184 168 1.31239 1.3125 0.0799233 0.0899297 2024-09-16T07:43:34.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:34.438+0000 7f65b3d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:34.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:34.451+0000 7f65b3d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:34.473 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:34.473 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:34.473 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:34.473 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:34.473 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:34.473 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:34.474 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:34.474 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:34.474 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:34.474 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:34.474 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:34.474 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:34.475 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:34.475 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:34.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:43:34.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:34.613+0000 7f7922a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:34.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:34.628+0000 7f7922a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:34.669 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:34.673 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:34.673 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:34.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:43:34.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:34.813+0000 7f4862511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:34.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:34.824+0000 7f4862511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:34.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:43:34.981 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:43:34.982 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:43:34.982 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:43:34.982 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:43:34.984 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:43:34.984 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:43:35.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:35.015+0000 7f27cc591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:35.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:35.023+0000 7f27cc591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:35.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 2 16 360 344 1.34361 1.375 0.0697266 0.089902 2024-09-16T07:43:36.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 3 16 542 526 1.36965 1.42188 0.0542558 0.0905164 2024-09-16T07:43:37.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:37.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 4 16 719 703 1.37291 1.38281 0.156282 0.0890772 2024-09-16T07:43:37.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:37.485+0000 7f77f4511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:37.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:37.492+0000 7f77f4511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:38.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 5 16 908 892 1.39362 1.47656 0.0330429 0.0890225 2024-09-16T07:43:39.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 6 16 1078 1062 1.38268 1.32812 0.128596 0.0897298 2024-09-16T07:43:39.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:39.981+0000 7f33ceb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:39.985 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:39.985 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:39.985 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:43:39.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:39.990+0000 7f33ceb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:40.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:40.109+0000 7f0ec32bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:40.123+0000 7f0ec32bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:40.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 7 16 1243 1227 1.36929 1.28906 0.0823915 0.0909686 2024-09-16T07:43:40.484 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:43:40.484 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:43:40.504 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-16T07:43:39.741283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":369212,"kb_used_data":173052,"kb_used_omap":0,"kb_used_meta":196096,"kb_avail":377118148,"statfs":{"total":386547056640,"available":386168983552,"internally_reserved":0,"allocated":177205248,"data_stored":353942037,"data_compressed":18251667,"data_compressed_allocated":176017408,"data_compressed_original":353509376,"omap_allocated":0,"internal_metadata":200802304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001617"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.303250+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:43:05.303250+0000","last_peered":"2024-09-16T07:43:05.303250+0000","last_clean":"2024-09-16T07:43:05.303250+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:43:05.303250+0000","last_undegraded":"2024-09-16T07:43:05.303250+0000","last_fullsized":"2024-09-16T07:43:05.303250+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.333725+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:43:05.333725+0000","last_peered":"2024-09-16T07:43:05.333725+0000","last_clean":"2024-09-16T07:43:05.333725+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:43:05.333725+0000","last_undegraded":"2024-09-16T07:43:05.333725+0000","last_fullsized":"2024-09-16T07:43:05.333725+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.314374+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:43:05.314374+0000","last_peered":"2024-09-16T07:43:05.314374+0000","last_clean":"2024-09-16T07:43:05.314374+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:43:05.314374+0000","last_undegraded":"2024-09-16T07:43:05.314374+0000","last_fullsized":"2024-09-16T07:43:05.314374+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.326232+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:43:05.326232+0000","last_peered":"2024-09-16T07:43:05.326232+0000","last_clean":"2024-09-16T07:43:05.326232+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:43:05.326232+0000","last_undegraded":"2024-09-16T07:43:05.326232+0000","last_fullsized":"2024-09-16T07:43:05.326232+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.325050+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:43:05.325050+0000","last_peered":"2024-09-16T07:43:05.325050+0000","last_clean":"2024-09-16T07:43:05.325050+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:43:05.325050+0000","last_undegraded":"2024-09-16T07:43:05.325050+0000","last_fullsized":"2024-09-16T07:43:05.325050+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.320103+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:43:05.320103+0000","last_peered":"2024-09-16T07:43:05.320103+0000","last_clean":"2024-09-16T07:43:05.320103+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:43:05.320103+0000","last_undegraded":"2024-09-16T07:43:05.320103+0000","last_fullsized":"2024-09-16T07:43:05.320103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.318915+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:43:05.318915+0000","last_peered":"2024-09-16T07:43:05.318915+0000","last_clean":"2024-09-16T07:43:05.318915+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:43:05.318915+0000","last_undegraded":"2024-09-16T07:43:05.318915+0000","last_fullsized":"2024-09-16T07:43:05.318915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.301609+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:43:05.301609+0000","last_peered":"2024-09-16T07:43:05.301609+0000","last_clean":"2024-09-16T07:43:05.301609+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:43:05.301609+0000","last_undegraded":"2024-09-16T07:43:05.301609+0000","last_fullsized":"2024-09-16T07:43:05.301609+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:43:31.275127+0000","last_change":"2024-09-16T07:43:31.275127+0000","last_active":"2024-09-16T07:43:31.275127+0000","last_peered":"2024-09-16T07:43:31.275127+0000","last_clean":"2024-09-16T07:43:31.275127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:43:31.275127+0000","last_undegraded":"2024-09-16T07:43:31.275127+0000","last_fullsized":"2024-09-16T07:43:31.275127+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-16T07:43:05.319128+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:43:05.319128+0000","last_peered":"2024-09-16T07:43:05.319128+0000","last_clean":"2024-09-16T07:43:05.319128+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:43:05.319128+0000","last_undegraded":"2024-09-16T07:43:05.319128+0000","last_fullsized":"2024-09-16T07:43:05.319128+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95764,"kb_used_data":50884,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94276076,"statfs":{"total":96636764160,"available":96538701824,"internally_reserved":0,"allocated":52105216,"data_stored":103740658,"data_compressed":5350781,"data_compressed_allocated":51822592,"data_compressed_original":103645184,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103840,"kb_used_data":50640,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94268000,"statfs":{"total":96636764160,"available":96530432000,"internally_reserved":0,"allocated":51855360,"data_stored":103708434,"data_compressed":5348646,"data_compressed_allocated":51552256,"data_compressed_original":103596032,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92972,"kb_used_data":39772,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94278868,"statfs":{"total":96636764160,"available":96541560832,"internally_reserved":0,"allocated":40726528,"data_stored":81450770,"data_compressed":4199671,"data_compressed_allocated":40423424,"data_compressed_original":81338368,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76636,"kb_used_data":31756,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94295204,"statfs":{"total":96636764160,"available":96558288896,"internally_reserved":0,"allocated":32518144,"data_stored":65042175,"data_compressed":3352569,"data_compressed_allocated":32219136,"data_compressed_original":64929792,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:43:41.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 8 16 1391 1375 1.34265 1.15625 0.0927769 0.092389 2024-09-16T07:43:42.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 9 16 1548 1532 1.32974 1.22656 0.11626 0.0933691 2024-09-16T07:43:42.566 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:42.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:42.704+0000 7f0ade548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:42.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:42.712+0000 7f0ade548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:43.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 10 16 1725 1709 1.33504 1.38281 0.0515009 0.093235 2024-09-16T07:43:44.368 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 11 16 1917 1901 1.35002 1.5 0.157964 0.0920473 2024-09-16T07:43:44.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:45.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:45.062+0000 7f7dfa751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:45.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:45.069+0000 7f7dfa751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:45.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 12 16 2086 2070 1.34753 1.32031 0.152054 0.0920505 2024-09-16T07:43:45.506 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:45.506 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:45.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:43:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:45.658+0000 7f85b6951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:45.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:45.667+0000 7f85b6951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:45.882 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:43:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:43:45.900 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-16T07:43:45.742556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16892467,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2071,"num_write_kb":17028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2045,"ondisk_log_size":2045,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":240692,"kb_used_data":23728,"kb_used_omap":0,"kb_used_meta":216896,"kb_avail":377246668,"statfs":{"total":386547056640,"available":386300588032,"internally_reserved":0,"allocated":24297472,"data_stored":47888001,"data_compressed":2445429,"data_compressed_allocated":22962176,"data_compressed_original":47398912,"omap_allocated":0,"internal_metadata":222101504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16302080,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":15920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002480"},"pg_stats":[{"pgid":"5.f","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.216143+0000","last_change":"2024-09-16T07:43:32.425787+0000","last_active":"2024-09-16T07:43:44.216143+0000","last_peered":"2024-09-16T07:43:44.216143+0000","last_clean":"2024-09-16T07:43:44.216143+0000","last_became_active":"2024-09-16T07:43:32.419042+0000","last_became_peered":"2024-09-16T07:43:32.419042+0000","last_unstale":"2024-09-16T07:43:44.216143+0000","last_undegraded":"2024-09-16T07:43:44.216143+0000","last_fullsized":"2024-09-16T07:43:44.216143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.150411+0000","last_change":"2024-09-16T07:43:32.475761+0000","last_active":"2024-09-16T07:43:44.150411+0000","last_peered":"2024-09-16T07:43:44.150411+0000","last_clean":"2024-09-16T07:43:44.150411+0000","last_became_active":"2024-09-16T07:43:32.466010+0000","last_became_peered":"2024-09-16T07:43:32.466010+0000","last_unstale":"2024-09-16T07:43:44.150411+0000","last_undegraded":"2024-09-16T07:43:44.150411+0000","last_fullsized":"2024-09-16T07:43:44.150411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"37'168","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.692636+0000","last_change":"2024-09-16T07:43:32.446194+0000","last_active":"2024-09-16T07:43:44.692636+0000","last_peered":"2024-09-16T07:43:44.692636+0000","last_clean":"2024-09-16T07:43:44.692636+0000","last_became_active":"2024-09-16T07:43:32.430490+0000","last_became_peered":"2024-09-16T07:43:32.430490+0000","last_unstale":"2024-09-16T07:43:44.692636+0000","last_undegraded":"2024-09-16T07:43:44.692636+0000","last_fullsized":"2024-09-16T07:43:44.692636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"37'87","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.746580+0000","last_change":"2024-09-16T07:43:32.475327+0000","last_active":"2024-09-16T07:43:44.746580+0000","last_peered":"2024-09-16T07:43:44.746580+0000","last_clean":"2024-09-16T07:43:44.746580+0000","last_became_active":"2024-09-16T07:43:32.468309+0000","last_became_peered":"2024-09-16T07:43:32.468309+0000","last_unstale":"2024-09-16T07:43:44.746580+0000","last_undegraded":"2024-09-16T07:43:44.746580+0000","last_fullsized":"2024-09-16T07:43:44.746580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712704,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'160","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.646000+0000","last_change":"2024-09-16T07:43:32.417052+0000","last_active":"2024-09-16T07:43:44.646000+0000","last_peered":"2024-09-16T07:43:44.646000+0000","last_clean":"2024-09-16T07:43:44.646000+0000","last_became_active":"2024-09-16T07:43:32.410819+0000","last_became_peered":"2024-09-16T07:43:32.410819+0000","last_unstale":"2024-09-16T07:43:44.646000+0000","last_undegraded":"2024-09-16T07:43:44.646000+0000","last_fullsized":"2024-09-16T07:43:44.646000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"37'104","reported_seq":116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.520036+0000","last_change":"2024-09-16T07:43:32.441596+0000","last_active":"2024-09-16T07:43:44.520036+0000","last_peered":"2024-09-16T07:43:44.520036+0000","last_clean":"2024-09-16T07:43:44.520036+0000","last_became_active":"2024-09-16T07:43:32.421884+0000","last_became_peered":"2024-09-16T07:43:32.421884+0000","last_unstale":"2024-09-16T07:43:44.520036+0000","last_undegraded":"2024-09-16T07:43:44.520036+0000","last_fullsized":"2024-09-16T07:43:44.520036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.532943+0000","last_change":"2024-09-16T07:43:32.406511+0000","last_active":"2024-09-16T07:43:43.532943+0000","last_peered":"2024-09-16T07:43:43.532943+0000","last_clean":"2024-09-16T07:43:43.532943+0000","last_became_active":"2024-09-16T07:43:32.393311+0000","last_became_peered":"2024-09-16T07:43:32.393311+0000","last_unstale":"2024-09-16T07:43:43.532943+0000","last_undegraded":"2024-09-16T07:43:43.532943+0000","last_fullsized":"2024-09-16T07:43:43.532943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"37'96","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:40.904425+0000","last_change":"2024-09-16T07:43:32.405182+0000","last_active":"2024-09-16T07:43:40.904425+0000","last_peered":"2024-09-16T07:43:40.904425+0000","last_clean":"2024-09-16T07:43:40.904425+0000","last_became_active":"2024-09-16T07:43:32.392235+0000","last_became_peered":"2024-09-16T07:43:32.392235+0000","last_unstale":"2024-09-16T07:43:40.904425+0000","last_undegraded":"2024-09-16T07:43:40.904425+0000","last_fullsized":"2024-09-16T07:43:40.904425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"37'144","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.539748+0000","last_change":"2024-09-16T07:43:32.434476+0000","last_active":"2024-09-16T07:43:43.539748+0000","last_peered":"2024-09-16T07:43:43.539748+0000","last_clean":"2024-09-16T07:43:43.539748+0000","last_became_active":"2024-09-16T07:43:32.411780+0000","last_became_peered":"2024-09-16T07:43:32.411780+0000","last_unstale":"2024-09-16T07:43:43.539748+0000","last_undegraded":"2024-09-16T07:43:43.539748+0000","last_fullsized":"2024-09-16T07:43:43.539748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":154,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.296684+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:43:33.296684+0000","last_peered":"2024-09-16T07:43:33.296684+0000","last_clean":"2024-09-16T07:43:33.296684+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:43:33.296684+0000","last_undegraded":"2024-09-16T07:43:33.296684+0000","last_fullsized":"2024-09-16T07:43:33.296684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.302145+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:43:33.302145+0000","last_peered":"2024-09-16T07:43:33.302145+0000","last_clean":"2024-09-16T07:43:33.302145+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:43:33.302145+0000","last_undegraded":"2024-09-16T07:43:33.302145+0000","last_fullsized":"2024-09-16T07:43:33.302145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.976241+0000","last_change":"2024-09-16T07:43:32.424957+0000","last_active":"2024-09-16T07:43:43.976241+0000","last_peered":"2024-09-16T07:43:43.976241+0000","last_clean":"2024-09-16T07:43:43.976241+0000","last_became_active":"2024-09-16T07:43:32.416782+0000","last_became_peered":"2024-09-16T07:43:32.416782+0000","last_unstale":"2024-09-16T07:43:43.976241+0000","last_undegraded":"2024-09-16T07:43:43.976241+0000","last_fullsized":"2024-09-16T07:43:43.976241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.297962+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:43:33.297962+0000","last_peered":"2024-09-16T07:43:33.297962+0000","last_clean":"2024-09-16T07:43:33.297962+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:43:33.297962+0000","last_undegraded":"2024-09-16T07:43:33.297962+0000","last_fullsized":"2024-09-16T07:43:33.297962+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.390855+0000","last_change":"2024-09-16T07:43:32.400263+0000","last_active":"2024-09-16T07:43:44.390855+0000","last_peered":"2024-09-16T07:43:44.390855+0000","last_clean":"2024-09-16T07:43:44.390855+0000","last_became_active":"2024-09-16T07:43:32.392833+0000","last_became_peered":"2024-09-16T07:43:32.392833+0000","last_unstale":"2024-09-16T07:43:44.390855+0000","last_undegraded":"2024-09-16T07:43:44.390855+0000","last_fullsized":"2024-09-16T07:43:44.390855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.301052+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:43:33.301052+0000","last_peered":"2024-09-16T07:43:33.301052+0000","last_clean":"2024-09-16T07:43:33.301052+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:43:33.301052+0000","last_undegraded":"2024-09-16T07:43:33.301052+0000","last_fullsized":"2024-09-16T07:43:33.301052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'123","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.752354+0000","last_change":"2024-09-16T07:43:32.466109+0000","last_active":"2024-09-16T07:43:44.752354+0000","last_peered":"2024-09-16T07:43:44.752354+0000","last_clean":"2024-09-16T07:43:44.752354+0000","last_became_active":"2024-09-16T07:43:32.455735+0000","last_became_peered":"2024-09-16T07:43:32.455735+0000","last_unstale":"2024-09-16T07:43:44.752354+0000","last_undegraded":"2024-09-16T07:43:44.752354+0000","last_fullsized":"2024-09-16T07:43:44.752354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1007616,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.303034+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:43:33.303034+0000","last_peered":"2024-09-16T07:43:33.303034+0000","last_clean":"2024-09-16T07:43:33.303034+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:43:33.303034+0000","last_undegraded":"2024-09-16T07:43:33.303034+0000","last_fullsized":"2024-09-16T07:43:33.303034+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"37'152","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:42.010616+0000","last_change":"2024-09-16T07:43:32.461294+0000","last_active":"2024-09-16T07:43:42.010616+0000","last_peered":"2024-09-16T07:43:42.010616+0000","last_clean":"2024-09-16T07:43:42.010616+0000","last_became_active":"2024-09-16T07:43:32.449642+0000","last_became_peered":"2024-09-16T07:43:32.449642+0000","last_unstale":"2024-09-16T07:43:42.010616+0000","last_undegraded":"2024-09-16T07:43:42.010616+0000","last_fullsized":"2024-09-16T07:43:42.010616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.307354+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:43:33.307354+0000","last_peered":"2024-09-16T07:43:33.307354+0000","last_clean":"2024-09-16T07:43:33.307354+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:43:33.307354+0000","last_undegraded":"2024-09-16T07:43:33.307354+0000","last_fullsized":"2024-09-16T07:43:33.307354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"37'132","reported_seq":144,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.747596+0000","last_change":"2024-09-16T07:43:32.403022+0000","last_active":"2024-09-16T07:43:44.747596+0000","last_peered":"2024-09-16T07:43:44.747596+0000","last_clean":"2024-09-16T07:43:44.747596+0000","last_became_active":"2024-09-16T07:43:32.387358+0000","last_became_peered":"2024-09-16T07:43:32.387358+0000","last_unstale":"2024-09-16T07:43:44.747596+0000","last_undegraded":"2024-09-16T07:43:44.747596+0000","last_fullsized":"2024-09-16T07:43:44.747596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.304078+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:43:33.304078+0000","last_peered":"2024-09-16T07:43:33.304078+0000","last_clean":"2024-09-16T07:43:33.304078+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:43:33.304078+0000","last_undegraded":"2024-09-16T07:43:33.304078+0000","last_fullsized":"2024-09-16T07:43:33.304078+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.066154+0000","last_change":"2024-09-16T07:43:32.439788+0000","last_active":"2024-09-16T07:43:43.066154+0000","last_peered":"2024-09-16T07:43:43.066154+0000","last_clean":"2024-09-16T07:43:43.066154+0000","last_became_active":"2024-09-16T07:43:32.430373+0000","last_became_peered":"2024-09-16T07:43:32.430373+0000","last_unstale":"2024-09-16T07:43:43.066154+0000","last_undegraded":"2024-09-16T07:43:43.066154+0000","last_fullsized":"2024-09-16T07:43:43.066154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.299842+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:43:33.299842+0000","last_peered":"2024-09-16T07:43:33.299842+0000","last_clean":"2024-09-16T07:43:33.299842+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:43:33.299842+0000","last_undegraded":"2024-09-16T07:43:33.299842+0000","last_fullsized":"2024-09-16T07:43:33.299842+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"37'88","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.455907+0000","last_change":"2024-09-16T07:43:32.470686+0000","last_active":"2024-09-16T07:43:44.455907+0000","last_peered":"2024-09-16T07:43:44.455907+0000","last_clean":"2024-09-16T07:43:44.455907+0000","last_became_active":"2024-09-16T07:43:32.463473+0000","last_became_peered":"2024-09-16T07:43:32.463473+0000","last_unstale":"2024-09-16T07:43:44.455907+0000","last_undegraded":"2024-09-16T07:43:44.455907+0000","last_fullsized":"2024-09-16T07:43:44.455907+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.295667+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:43:33.295667+0000","last_peered":"2024-09-16T07:43:33.295667+0000","last_clean":"2024-09-16T07:43:33.295667+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:43:33.295667+0000","last_undegraded":"2024-09-16T07:43:33.295667+0000","last_fullsized":"2024-09-16T07:43:33.295667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":16302080,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":15920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24453120,"data_stored":48906240,"data_compressed":2521980,"data_compressed_allocated":24453120,"data_compressed_original":48906240,"omap_allocated":0,"internal_metadata":0},"log_size":1990,"ondisk_log_size":1990,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63504,"kb_used_data":6144,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94308336,"statfs":{"total":96636764160,"available":96571736064,"internally_reserved":0,"allocated":6291456,"data_stored":12053517,"data_compressed":615864,"data_compressed_allocated":5971968,"data_compressed_original":11943936,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59048,"kb_used_data":5844,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312792,"statfs":{"total":96636764160,"available":96576299008,"internally_reserved":0,"allocated":5984256,"data_stored":11906605,"data_compressed":607893,"data_compressed_allocated":5644288,"data_compressed_original":11780096,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53952,"kb_used_data":4912,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94317888,"statfs":{"total":96636764160,"available":96581517312,"internally_reserved":0,"allocated":5029888,"data_stored":9997869,"data_compressed":509440,"data_compressed_allocated":4689920,"data_compressed_original":9871360,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64188,"kb_used_data":6828,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307652,"statfs":{"total":96636764160,"available":96571035648,"internally_reserved":0,"allocated":6991872,"data_stored":13930010,"data_compressed":712232,"data_compressed_allocated":6656000,"data_compressed_original":13803520,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":14393344,"data_compressed":742261,"data_compressed_allocated":7196672,"data_compressed_original":14393344,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":9773056,"data_compressed":503937,"data_compressed_allocated":4886528,"data_compressed_original":9773056,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6017024,"data_stored":12034048,"data_compressed":620579,"data_compressed_allocated":6017024,"data_compressed_original":12034048,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":12705792,"data_compressed":655203,"data_compressed_allocated":6352896,"data_compressed_original":12705792,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:43:46.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 13 16 2257 2241 1.34663 1.33594 0.086143 0.0923995 2024-09-16T07:43:47.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 14 16 2416 2400 1.33916 1.24219 0.162531 0.0928405 2024-09-16T07:43:47.470 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:47.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:47.631+0000 7fe97af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:47.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:47.639+0000 7fe97af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:48.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 15 16 2602 2586 1.34675 1.45312 0.0932036 0.0925739 2024-09-16T07:43:49.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 16 16 2762 2746 1.34069 1.25 0.085724 0.0928927 2024-09-16T07:43:49.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:50.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:50.033+0000 7fb49c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:50.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:50.041+0000 7fb49c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:50.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 17 16 2922 2906 1.33535 1.25 0.10666 0.0934046 2024-09-16T07:43:50.902 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:50.902 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:43:50.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:43:51.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:51.040+0000 7f704ca7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:51.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:51.052+0000 7f704ca7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:51.319 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:43:51.320 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:43:51.335 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-16T07:43:49.743302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16892467,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2071,"num_write_kb":17028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2045,"ondisk_log_size":2045,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":240692,"kb_used_data":23728,"kb_used_omap":0,"kb_used_meta":216896,"kb_avail":377246668,"statfs":{"total":386547056640,"available":386300588032,"internally_reserved":0,"allocated":24297472,"data_stored":47888001,"data_compressed":2445429,"data_compressed_allocated":22962176,"data_compressed_original":47398912,"omap_allocated":0,"internal_metadata":222101504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16302080,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":15920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002388"},"pg_stats":[{"pgid":"5.f","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.216143+0000","last_change":"2024-09-16T07:43:32.425787+0000","last_active":"2024-09-16T07:43:44.216143+0000","last_peered":"2024-09-16T07:43:44.216143+0000","last_clean":"2024-09-16T07:43:44.216143+0000","last_became_active":"2024-09-16T07:43:32.419042+0000","last_became_peered":"2024-09-16T07:43:32.419042+0000","last_unstale":"2024-09-16T07:43:44.216143+0000","last_undegraded":"2024-09-16T07:43:44.216143+0000","last_fullsized":"2024-09-16T07:43:44.216143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.150411+0000","last_change":"2024-09-16T07:43:32.475761+0000","last_active":"2024-09-16T07:43:44.150411+0000","last_peered":"2024-09-16T07:43:44.150411+0000","last_clean":"2024-09-16T07:43:44.150411+0000","last_became_active":"2024-09-16T07:43:32.466010+0000","last_became_peered":"2024-09-16T07:43:32.466010+0000","last_unstale":"2024-09-16T07:43:44.150411+0000","last_undegraded":"2024-09-16T07:43:44.150411+0000","last_fullsized":"2024-09-16T07:43:44.150411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"37'168","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.692636+0000","last_change":"2024-09-16T07:43:32.446194+0000","last_active":"2024-09-16T07:43:44.692636+0000","last_peered":"2024-09-16T07:43:44.692636+0000","last_clean":"2024-09-16T07:43:44.692636+0000","last_became_active":"2024-09-16T07:43:32.430490+0000","last_became_peered":"2024-09-16T07:43:32.430490+0000","last_unstale":"2024-09-16T07:43:44.692636+0000","last_undegraded":"2024-09-16T07:43:44.692636+0000","last_fullsized":"2024-09-16T07:43:44.692636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"37'87","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.746580+0000","last_change":"2024-09-16T07:43:32.475327+0000","last_active":"2024-09-16T07:43:44.746580+0000","last_peered":"2024-09-16T07:43:44.746580+0000","last_clean":"2024-09-16T07:43:44.746580+0000","last_became_active":"2024-09-16T07:43:32.468309+0000","last_became_peered":"2024-09-16T07:43:32.468309+0000","last_unstale":"2024-09-16T07:43:44.746580+0000","last_undegraded":"2024-09-16T07:43:44.746580+0000","last_fullsized":"2024-09-16T07:43:44.746580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712704,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'160","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.646000+0000","last_change":"2024-09-16T07:43:32.417052+0000","last_active":"2024-09-16T07:43:44.646000+0000","last_peered":"2024-09-16T07:43:44.646000+0000","last_clean":"2024-09-16T07:43:44.646000+0000","last_became_active":"2024-09-16T07:43:32.410819+0000","last_became_peered":"2024-09-16T07:43:32.410819+0000","last_unstale":"2024-09-16T07:43:44.646000+0000","last_undegraded":"2024-09-16T07:43:44.646000+0000","last_fullsized":"2024-09-16T07:43:44.646000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"37'104","reported_seq":116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.520036+0000","last_change":"2024-09-16T07:43:32.441596+0000","last_active":"2024-09-16T07:43:44.520036+0000","last_peered":"2024-09-16T07:43:44.520036+0000","last_clean":"2024-09-16T07:43:44.520036+0000","last_became_active":"2024-09-16T07:43:32.421884+0000","last_became_peered":"2024-09-16T07:43:32.421884+0000","last_unstale":"2024-09-16T07:43:44.520036+0000","last_undegraded":"2024-09-16T07:43:44.520036+0000","last_fullsized":"2024-09-16T07:43:44.520036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.532943+0000","last_change":"2024-09-16T07:43:32.406511+0000","last_active":"2024-09-16T07:43:43.532943+0000","last_peered":"2024-09-16T07:43:43.532943+0000","last_clean":"2024-09-16T07:43:43.532943+0000","last_became_active":"2024-09-16T07:43:32.393311+0000","last_became_peered":"2024-09-16T07:43:32.393311+0000","last_unstale":"2024-09-16T07:43:43.532943+0000","last_undegraded":"2024-09-16T07:43:43.532943+0000","last_fullsized":"2024-09-16T07:43:43.532943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"37'96","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:40.904425+0000","last_change":"2024-09-16T07:43:32.405182+0000","last_active":"2024-09-16T07:43:40.904425+0000","last_peered":"2024-09-16T07:43:40.904425+0000","last_clean":"2024-09-16T07:43:40.904425+0000","last_became_active":"2024-09-16T07:43:32.392235+0000","last_became_peered":"2024-09-16T07:43:32.392235+0000","last_unstale":"2024-09-16T07:43:40.904425+0000","last_undegraded":"2024-09-16T07:43:40.904425+0000","last_fullsized":"2024-09-16T07:43:40.904425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"37'144","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.539748+0000","last_change":"2024-09-16T07:43:32.434476+0000","last_active":"2024-09-16T07:43:43.539748+0000","last_peered":"2024-09-16T07:43:43.539748+0000","last_clean":"2024-09-16T07:43:43.539748+0000","last_became_active":"2024-09-16T07:43:32.411780+0000","last_became_peered":"2024-09-16T07:43:32.411780+0000","last_unstale":"2024-09-16T07:43:43.539748+0000","last_undegraded":"2024-09-16T07:43:43.539748+0000","last_fullsized":"2024-09-16T07:43:43.539748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":154,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.296684+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:43:33.296684+0000","last_peered":"2024-09-16T07:43:33.296684+0000","last_clean":"2024-09-16T07:43:33.296684+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:43:33.296684+0000","last_undegraded":"2024-09-16T07:43:33.296684+0000","last_fullsized":"2024-09-16T07:43:33.296684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.302145+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:43:33.302145+0000","last_peered":"2024-09-16T07:43:33.302145+0000","last_clean":"2024-09-16T07:43:33.302145+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:43:33.302145+0000","last_undegraded":"2024-09-16T07:43:33.302145+0000","last_fullsized":"2024-09-16T07:43:33.302145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.976241+0000","last_change":"2024-09-16T07:43:32.424957+0000","last_active":"2024-09-16T07:43:43.976241+0000","last_peered":"2024-09-16T07:43:43.976241+0000","last_clean":"2024-09-16T07:43:43.976241+0000","last_became_active":"2024-09-16T07:43:32.416782+0000","last_became_peered":"2024-09-16T07:43:32.416782+0000","last_unstale":"2024-09-16T07:43:43.976241+0000","last_undegraded":"2024-09-16T07:43:43.976241+0000","last_fullsized":"2024-09-16T07:43:43.976241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.297962+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:43:33.297962+0000","last_peered":"2024-09-16T07:43:33.297962+0000","last_clean":"2024-09-16T07:43:33.297962+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:43:33.297962+0000","last_undegraded":"2024-09-16T07:43:33.297962+0000","last_fullsized":"2024-09-16T07:43:33.297962+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.390855+0000","last_change":"2024-09-16T07:43:32.400263+0000","last_active":"2024-09-16T07:43:44.390855+0000","last_peered":"2024-09-16T07:43:44.390855+0000","last_clean":"2024-09-16T07:43:44.390855+0000","last_became_active":"2024-09-16T07:43:32.392833+0000","last_became_peered":"2024-09-16T07:43:32.392833+0000","last_unstale":"2024-09-16T07:43:44.390855+0000","last_undegraded":"2024-09-16T07:43:44.390855+0000","last_fullsized":"2024-09-16T07:43:44.390855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.301052+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:43:33.301052+0000","last_peered":"2024-09-16T07:43:33.301052+0000","last_clean":"2024-09-16T07:43:33.301052+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:43:33.301052+0000","last_undegraded":"2024-09-16T07:43:33.301052+0000","last_fullsized":"2024-09-16T07:43:33.301052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'123","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.752354+0000","last_change":"2024-09-16T07:43:32.466109+0000","last_active":"2024-09-16T07:43:44.752354+0000","last_peered":"2024-09-16T07:43:44.752354+0000","last_clean":"2024-09-16T07:43:44.752354+0000","last_became_active":"2024-09-16T07:43:32.455735+0000","last_became_peered":"2024-09-16T07:43:32.455735+0000","last_unstale":"2024-09-16T07:43:44.752354+0000","last_undegraded":"2024-09-16T07:43:44.752354+0000","last_fullsized":"2024-09-16T07:43:44.752354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1007616,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.303034+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:43:33.303034+0000","last_peered":"2024-09-16T07:43:33.303034+0000","last_clean":"2024-09-16T07:43:33.303034+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:43:33.303034+0000","last_undegraded":"2024-09-16T07:43:33.303034+0000","last_fullsized":"2024-09-16T07:43:33.303034+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"37'152","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:42.010616+0000","last_change":"2024-09-16T07:43:32.461294+0000","last_active":"2024-09-16T07:43:42.010616+0000","last_peered":"2024-09-16T07:43:42.010616+0000","last_clean":"2024-09-16T07:43:42.010616+0000","last_became_active":"2024-09-16T07:43:32.449642+0000","last_became_peered":"2024-09-16T07:43:32.449642+0000","last_unstale":"2024-09-16T07:43:42.010616+0000","last_undegraded":"2024-09-16T07:43:42.010616+0000","last_fullsized":"2024-09-16T07:43:42.010616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.307354+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:43:33.307354+0000","last_peered":"2024-09-16T07:43:33.307354+0000","last_clean":"2024-09-16T07:43:33.307354+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:43:33.307354+0000","last_undegraded":"2024-09-16T07:43:33.307354+0000","last_fullsized":"2024-09-16T07:43:33.307354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"37'132","reported_seq":144,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.747596+0000","last_change":"2024-09-16T07:43:32.403022+0000","last_active":"2024-09-16T07:43:44.747596+0000","last_peered":"2024-09-16T07:43:44.747596+0000","last_clean":"2024-09-16T07:43:44.747596+0000","last_became_active":"2024-09-16T07:43:32.387358+0000","last_became_peered":"2024-09-16T07:43:32.387358+0000","last_unstale":"2024-09-16T07:43:44.747596+0000","last_undegraded":"2024-09-16T07:43:44.747596+0000","last_fullsized":"2024-09-16T07:43:44.747596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.304078+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:43:33.304078+0000","last_peered":"2024-09-16T07:43:33.304078+0000","last_clean":"2024-09-16T07:43:33.304078+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:43:33.304078+0000","last_undegraded":"2024-09-16T07:43:33.304078+0000","last_fullsized":"2024-09-16T07:43:33.304078+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.066154+0000","last_change":"2024-09-16T07:43:32.439788+0000","last_active":"2024-09-16T07:43:43.066154+0000","last_peered":"2024-09-16T07:43:43.066154+0000","last_clean":"2024-09-16T07:43:43.066154+0000","last_became_active":"2024-09-16T07:43:32.430373+0000","last_became_peered":"2024-09-16T07:43:32.430373+0000","last_unstale":"2024-09-16T07:43:43.066154+0000","last_undegraded":"2024-09-16T07:43:43.066154+0000","last_fullsized":"2024-09-16T07:43:43.066154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.299842+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:43:33.299842+0000","last_peered":"2024-09-16T07:43:33.299842+0000","last_clean":"2024-09-16T07:43:33.299842+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:43:33.299842+0000","last_undegraded":"2024-09-16T07:43:33.299842+0000","last_fullsized":"2024-09-16T07:43:33.299842+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"37'88","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.455907+0000","last_change":"2024-09-16T07:43:32.470686+0000","last_active":"2024-09-16T07:43:44.455907+0000","last_peered":"2024-09-16T07:43:44.455907+0000","last_clean":"2024-09-16T07:43:44.455907+0000","last_became_active":"2024-09-16T07:43:32.463473+0000","last_became_peered":"2024-09-16T07:43:32.463473+0000","last_unstale":"2024-09-16T07:43:44.455907+0000","last_undegraded":"2024-09-16T07:43:44.455907+0000","last_fullsized":"2024-09-16T07:43:44.455907+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.295667+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:43:33.295667+0000","last_peered":"2024-09-16T07:43:33.295667+0000","last_clean":"2024-09-16T07:43:33.295667+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:43:33.295667+0000","last_undegraded":"2024-09-16T07:43:33.295667+0000","last_fullsized":"2024-09-16T07:43:33.295667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":16302080,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":15920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24453120,"data_stored":48906240,"data_compressed":2521980,"data_compressed_allocated":24453120,"data_compressed_original":48906240,"omap_allocated":0,"internal_metadata":0},"log_size":1990,"ondisk_log_size":1990,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63504,"kb_used_data":6144,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94308336,"statfs":{"total":96636764160,"available":96571736064,"internally_reserved":0,"allocated":6291456,"data_stored":12053517,"data_compressed":615864,"data_compressed_allocated":5971968,"data_compressed_original":11943936,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59048,"kb_used_data":5844,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312792,"statfs":{"total":96636764160,"available":96576299008,"internally_reserved":0,"allocated":5984256,"data_stored":11906605,"data_compressed":607893,"data_compressed_allocated":5644288,"data_compressed_original":11780096,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53952,"kb_used_data":4912,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94317888,"statfs":{"total":96636764160,"available":96581517312,"internally_reserved":0,"allocated":5029888,"data_stored":9997869,"data_compressed":509440,"data_compressed_allocated":4689920,"data_compressed_original":9871360,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64188,"kb_used_data":6828,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307652,"statfs":{"total":96636764160,"available":96571035648,"internally_reserved":0,"allocated":6991872,"data_stored":13930010,"data_compressed":712232,"data_compressed_allocated":6656000,"data_compressed_original":13803520,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":14393344,"data_compressed":742261,"data_compressed_allocated":7196672,"data_compressed_original":14393344,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":9773056,"data_compressed":503937,"data_compressed_allocated":4886528,"data_compressed_original":9773056,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6017024,"data_stored":12034048,"data_compressed":620579,"data_compressed_allocated":6017024,"data_compressed_original":12034048,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":12705792,"data_compressed":655203,"data_compressed_allocated":6352896,"data_compressed_original":12705792,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:43:51.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 18 16 3086 3070 1.33234 1.28125 0.055338 0.0936178 2024-09-16T07:43:52.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 19 16 3248 3232 1.32882 1.26562 0.0764472 0.0938427 2024-09-16T07:43:52.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:52.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:52.546+0000 7ff69d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:52.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:52.553+0000 7ff69d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:53.369 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:43:53.371262+0000 min lat: 0.0169709 max lat: 0.222427 avg lat: 0.0940031 2024-09-16T07:43:53.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:43:53.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 20 16 3408 3392 1.32488 1.25 0.089696 0.0940031 2024-09-16T07:43:54.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 21 16 3565 3549 1.32019 1.22656 0.0843894 0.0945044 2024-09-16T07:43:54.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:55.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:55.088+0000 7f2b64191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:55.095+0000 7f2b64191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:55.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 22 16 3726 3710 1.31735 1.25781 0.116978 0.0945793 2024-09-16T07:43:56.338 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:43:56.338 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:43:56.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 23 16 3882 3866 1.31305 1.21875 0.130976 0.0949187 2024-09-16T07:43:56.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:56.471+0000 7fb3e9efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:56.490+0000 7fb3e9efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:57.252 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:43:57.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:43:57.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 24 16 4050 4034 1.31303 1.3125 0.126462 0.0948622 2024-09-16T07:43:57.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:43:57.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:57.448+0000 7fe0404bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:57.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:57.466+0000 7fe0404bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:57.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:57.530+0000 7fe207d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:57.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:57.538+0000 7fe207d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:58.257 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:43:58.284 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:43:58.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 25 16 4220 4204 1.31363 1.32812 0.0561024 0.0950458 2024-09-16T07:43:58.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:58.424+0000 7f7b648c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:58.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:58.441+0000 7f7b648c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:59.263 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:43:59.282 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:43:59.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 26 16 4377 4361 1.31027 1.22656 0.118881 0.0953003 2024-09-16T07:43:59.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:59.430+0000 7fde328a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:59.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:59.441+0000 7fde328a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:59.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:43:59.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:59.951+0000 7f5842b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:43:59.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:43:59.959+0000 7f5842b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:44:00.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:44:00.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:44:00.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 27 16 4512 4496 1.3008 1.05469 0.0939733 0.0957474 2024-09-16T07:44:00.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:00.431+0000 7f83442d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:00.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:00.441+0000 7f83442d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:00.662 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:44:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:44:00.678 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-16T07:44:00.273882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16892467,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2071,"num_write_kb":17028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2045,"ondisk_log_size":2045,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":240692,"kb_used_data":23728,"kb_used_omap":0,"kb_used_meta":216896,"kb_avail":377246668,"statfs":{"total":386547056640,"available":386300588032,"internally_reserved":0,"allocated":24297472,"data_stored":47888001,"data_compressed":2445429,"data_compressed_allocated":22962176,"data_compressed_original":47398912,"omap_allocated":0,"internal_metadata":222101504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.529329"},"pg_stats":[{"pgid":"5.f","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.216143+0000","last_change":"2024-09-16T07:43:32.425787+0000","last_active":"2024-09-16T07:43:44.216143+0000","last_peered":"2024-09-16T07:43:44.216143+0000","last_clean":"2024-09-16T07:43:44.216143+0000","last_became_active":"2024-09-16T07:43:32.419042+0000","last_became_peered":"2024-09-16T07:43:32.419042+0000","last_unstale":"2024-09-16T07:43:44.216143+0000","last_undegraded":"2024-09-16T07:43:44.216143+0000","last_fullsized":"2024-09-16T07:43:44.216143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.150411+0000","last_change":"2024-09-16T07:43:32.475761+0000","last_active":"2024-09-16T07:43:44.150411+0000","last_peered":"2024-09-16T07:43:44.150411+0000","last_clean":"2024-09-16T07:43:44.150411+0000","last_became_active":"2024-09-16T07:43:32.466010+0000","last_became_peered":"2024-09-16T07:43:32.466010+0000","last_unstale":"2024-09-16T07:43:44.150411+0000","last_undegraded":"2024-09-16T07:43:44.150411+0000","last_fullsized":"2024-09-16T07:43:44.150411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"37'168","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.692636+0000","last_change":"2024-09-16T07:43:32.446194+0000","last_active":"2024-09-16T07:43:44.692636+0000","last_peered":"2024-09-16T07:43:44.692636+0000","last_clean":"2024-09-16T07:43:44.692636+0000","last_became_active":"2024-09-16T07:43:32.430490+0000","last_became_peered":"2024-09-16T07:43:32.430490+0000","last_unstale":"2024-09-16T07:43:44.692636+0000","last_undegraded":"2024-09-16T07:43:44.692636+0000","last_fullsized":"2024-09-16T07:43:44.692636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"37'87","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.746580+0000","last_change":"2024-09-16T07:43:32.475327+0000","last_active":"2024-09-16T07:43:44.746580+0000","last_peered":"2024-09-16T07:43:44.746580+0000","last_clean":"2024-09-16T07:43:44.746580+0000","last_became_active":"2024-09-16T07:43:32.468309+0000","last_became_peered":"2024-09-16T07:43:32.468309+0000","last_unstale":"2024-09-16T07:43:44.746580+0000","last_undegraded":"2024-09-16T07:43:44.746580+0000","last_fullsized":"2024-09-16T07:43:44.746580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712704,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'160","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.646000+0000","last_change":"2024-09-16T07:43:32.417052+0000","last_active":"2024-09-16T07:43:44.646000+0000","last_peered":"2024-09-16T07:43:44.646000+0000","last_clean":"2024-09-16T07:43:44.646000+0000","last_became_active":"2024-09-16T07:43:32.410819+0000","last_became_peered":"2024-09-16T07:43:32.410819+0000","last_unstale":"2024-09-16T07:43:44.646000+0000","last_undegraded":"2024-09-16T07:43:44.646000+0000","last_fullsized":"2024-09-16T07:43:44.646000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"37'104","reported_seq":116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.520036+0000","last_change":"2024-09-16T07:43:32.441596+0000","last_active":"2024-09-16T07:43:44.520036+0000","last_peered":"2024-09-16T07:43:44.520036+0000","last_clean":"2024-09-16T07:43:44.520036+0000","last_became_active":"2024-09-16T07:43:32.421884+0000","last_became_peered":"2024-09-16T07:43:32.421884+0000","last_unstale":"2024-09-16T07:43:44.520036+0000","last_undegraded":"2024-09-16T07:43:44.520036+0000","last_fullsized":"2024-09-16T07:43:44.520036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.532943+0000","last_change":"2024-09-16T07:43:32.406511+0000","last_active":"2024-09-16T07:43:43.532943+0000","last_peered":"2024-09-16T07:43:43.532943+0000","last_clean":"2024-09-16T07:43:43.532943+0000","last_became_active":"2024-09-16T07:43:32.393311+0000","last_became_peered":"2024-09-16T07:43:32.393311+0000","last_unstale":"2024-09-16T07:43:43.532943+0000","last_undegraded":"2024-09-16T07:43:43.532943+0000","last_fullsized":"2024-09-16T07:43:43.532943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"37'96","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:40.904425+0000","last_change":"2024-09-16T07:43:32.405182+0000","last_active":"2024-09-16T07:43:40.904425+0000","last_peered":"2024-09-16T07:43:40.904425+0000","last_clean":"2024-09-16T07:43:40.904425+0000","last_became_active":"2024-09-16T07:43:32.392235+0000","last_became_peered":"2024-09-16T07:43:32.392235+0000","last_unstale":"2024-09-16T07:43:40.904425+0000","last_undegraded":"2024-09-16T07:43:40.904425+0000","last_fullsized":"2024-09-16T07:43:40.904425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"37'144","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.539748+0000","last_change":"2024-09-16T07:43:32.434476+0000","last_active":"2024-09-16T07:43:43.539748+0000","last_peered":"2024-09-16T07:43:43.539748+0000","last_clean":"2024-09-16T07:43:43.539748+0000","last_became_active":"2024-09-16T07:43:32.411780+0000","last_became_peered":"2024-09-16T07:43:32.411780+0000","last_unstale":"2024-09-16T07:43:43.539748+0000","last_undegraded":"2024-09-16T07:43:43.539748+0000","last_fullsized":"2024-09-16T07:43:43.539748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":154,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.296684+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:43:33.296684+0000","last_peered":"2024-09-16T07:43:33.296684+0000","last_clean":"2024-09-16T07:43:33.296684+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:43:33.296684+0000","last_undegraded":"2024-09-16T07:43:33.296684+0000","last_fullsized":"2024-09-16T07:43:33.296684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.302145+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:43:33.302145+0000","last_peered":"2024-09-16T07:43:33.302145+0000","last_clean":"2024-09-16T07:43:33.302145+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:43:33.302145+0000","last_undegraded":"2024-09-16T07:43:33.302145+0000","last_fullsized":"2024-09-16T07:43:33.302145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.976241+0000","last_change":"2024-09-16T07:43:32.424957+0000","last_active":"2024-09-16T07:43:43.976241+0000","last_peered":"2024-09-16T07:43:43.976241+0000","last_clean":"2024-09-16T07:43:43.976241+0000","last_became_active":"2024-09-16T07:43:32.416782+0000","last_became_peered":"2024-09-16T07:43:32.416782+0000","last_unstale":"2024-09-16T07:43:43.976241+0000","last_undegraded":"2024-09-16T07:43:43.976241+0000","last_fullsized":"2024-09-16T07:43:43.976241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.297962+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:43:33.297962+0000","last_peered":"2024-09-16T07:43:33.297962+0000","last_clean":"2024-09-16T07:43:33.297962+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:43:33.297962+0000","last_undegraded":"2024-09-16T07:43:33.297962+0000","last_fullsized":"2024-09-16T07:43:33.297962+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.390855+0000","last_change":"2024-09-16T07:43:32.400263+0000","last_active":"2024-09-16T07:43:44.390855+0000","last_peered":"2024-09-16T07:43:44.390855+0000","last_clean":"2024-09-16T07:43:44.390855+0000","last_became_active":"2024-09-16T07:43:32.392833+0000","last_became_peered":"2024-09-16T07:43:32.392833+0000","last_unstale":"2024-09-16T07:43:44.390855+0000","last_undegraded":"2024-09-16T07:43:44.390855+0000","last_fullsized":"2024-09-16T07:43:44.390855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.301052+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:43:33.301052+0000","last_peered":"2024-09-16T07:43:33.301052+0000","last_clean":"2024-09-16T07:43:33.301052+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:43:33.301052+0000","last_undegraded":"2024-09-16T07:43:33.301052+0000","last_fullsized":"2024-09-16T07:43:33.301052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'123","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.752354+0000","last_change":"2024-09-16T07:43:32.466109+0000","last_active":"2024-09-16T07:43:44.752354+0000","last_peered":"2024-09-16T07:43:44.752354+0000","last_clean":"2024-09-16T07:43:44.752354+0000","last_became_active":"2024-09-16T07:43:32.455735+0000","last_became_peered":"2024-09-16T07:43:32.455735+0000","last_unstale":"2024-09-16T07:43:44.752354+0000","last_undegraded":"2024-09-16T07:43:44.752354+0000","last_fullsized":"2024-09-16T07:43:44.752354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1007616,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.303034+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:43:33.303034+0000","last_peered":"2024-09-16T07:43:33.303034+0000","last_clean":"2024-09-16T07:43:33.303034+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:43:33.303034+0000","last_undegraded":"2024-09-16T07:43:33.303034+0000","last_fullsized":"2024-09-16T07:43:33.303034+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"37'152","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:42.010616+0000","last_change":"2024-09-16T07:43:32.461294+0000","last_active":"2024-09-16T07:43:42.010616+0000","last_peered":"2024-09-16T07:43:42.010616+0000","last_clean":"2024-09-16T07:43:42.010616+0000","last_became_active":"2024-09-16T07:43:32.449642+0000","last_became_peered":"2024-09-16T07:43:32.449642+0000","last_unstale":"2024-09-16T07:43:42.010616+0000","last_undegraded":"2024-09-16T07:43:42.010616+0000","last_fullsized":"2024-09-16T07:43:42.010616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.307354+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:43:33.307354+0000","last_peered":"2024-09-16T07:43:33.307354+0000","last_clean":"2024-09-16T07:43:33.307354+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:43:33.307354+0000","last_undegraded":"2024-09-16T07:43:33.307354+0000","last_fullsized":"2024-09-16T07:43:33.307354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"37'132","reported_seq":144,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.747596+0000","last_change":"2024-09-16T07:43:32.403022+0000","last_active":"2024-09-16T07:43:44.747596+0000","last_peered":"2024-09-16T07:43:44.747596+0000","last_clean":"2024-09-16T07:43:44.747596+0000","last_became_active":"2024-09-16T07:43:32.387358+0000","last_became_peered":"2024-09-16T07:43:32.387358+0000","last_unstale":"2024-09-16T07:43:44.747596+0000","last_undegraded":"2024-09-16T07:43:44.747596+0000","last_fullsized":"2024-09-16T07:43:44.747596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.304078+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:43:33.304078+0000","last_peered":"2024-09-16T07:43:33.304078+0000","last_clean":"2024-09-16T07:43:33.304078+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:43:33.304078+0000","last_undegraded":"2024-09-16T07:43:33.304078+0000","last_fullsized":"2024-09-16T07:43:33.304078+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.066154+0000","last_change":"2024-09-16T07:43:32.439788+0000","last_active":"2024-09-16T07:43:43.066154+0000","last_peered":"2024-09-16T07:43:43.066154+0000","last_clean":"2024-09-16T07:43:43.066154+0000","last_became_active":"2024-09-16T07:43:32.430373+0000","last_became_peered":"2024-09-16T07:43:32.430373+0000","last_unstale":"2024-09-16T07:43:43.066154+0000","last_undegraded":"2024-09-16T07:43:43.066154+0000","last_fullsized":"2024-09-16T07:43:43.066154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.299842+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:43:33.299842+0000","last_peered":"2024-09-16T07:43:33.299842+0000","last_clean":"2024-09-16T07:43:33.299842+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:43:33.299842+0000","last_undegraded":"2024-09-16T07:43:33.299842+0000","last_fullsized":"2024-09-16T07:43:33.299842+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"37'88","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.455907+0000","last_change":"2024-09-16T07:43:32.470686+0000","last_active":"2024-09-16T07:43:44.455907+0000","last_peered":"2024-09-16T07:43:44.455907+0000","last_clean":"2024-09-16T07:43:44.455907+0000","last_became_active":"2024-09-16T07:43:32.463473+0000","last_became_peered":"2024-09-16T07:43:32.463473+0000","last_unstale":"2024-09-16T07:43:44.455907+0000","last_undegraded":"2024-09-16T07:43:44.455907+0000","last_fullsized":"2024-09-16T07:43:44.455907+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.295667+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:43:33.295667+0000","last_peered":"2024-09-16T07:43:33.295667+0000","last_clean":"2024-09-16T07:43:33.295667+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:43:33.295667+0000","last_undegraded":"2024-09-16T07:43:33.295667+0000","last_fullsized":"2024-09-16T07:43:33.295667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":16302080,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":15920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24453120,"data_stored":48906240,"data_compressed":2521980,"data_compressed_allocated":24453120,"data_compressed_original":48906240,"omap_allocated":0,"internal_metadata":0},"log_size":1990,"ondisk_log_size":1990,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63504,"kb_used_data":6144,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94308336,"statfs":{"total":96636764160,"available":96571736064,"internally_reserved":0,"allocated":6291456,"data_stored":12053517,"data_compressed":615864,"data_compressed_allocated":5971968,"data_compressed_original":11943936,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59048,"kb_used_data":5844,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312792,"statfs":{"total":96636764160,"available":96576299008,"internally_reserved":0,"allocated":5984256,"data_stored":11906605,"data_compressed":607893,"data_compressed_allocated":5644288,"data_compressed_original":11780096,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53952,"kb_used_data":4912,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94317888,"statfs":{"total":96636764160,"available":96581517312,"internally_reserved":0,"allocated":5029888,"data_stored":9997869,"data_compressed":509440,"data_compressed_allocated":4689920,"data_compressed_original":9871360,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64188,"kb_used_data":6828,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307652,"statfs":{"total":96636764160,"available":96571035648,"internally_reserved":0,"allocated":6991872,"data_stored":13930010,"data_compressed":712232,"data_compressed_allocated":6656000,"data_compressed_original":13803520,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":14393344,"data_compressed":742261,"data_compressed_allocated":7196672,"data_compressed_original":14393344,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":9773056,"data_compressed":503937,"data_compressed_allocated":4886528,"data_compressed_original":9773056,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6017024,"data_stored":12034048,"data_compressed":620579,"data_compressed_allocated":6017024,"data_compressed_original":12034048,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":12705792,"data_compressed":655203,"data_compressed_allocated":6352896,"data_compressed_original":12705792,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:44:00.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:44:00.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:00.851+0000 7fe7d2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:00.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:00.861+0000 7fe7d2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:01.153 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:44:01.153 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:44:01.175 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-16T07:44:00.273882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16892467,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2071,"num_write_kb":17028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2045,"ondisk_log_size":2045,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":240692,"kb_used_data":23728,"kb_used_omap":0,"kb_used_meta":216896,"kb_avail":377246668,"statfs":{"total":386547056640,"available":386300588032,"internally_reserved":0,"allocated":24297472,"data_stored":47888001,"data_compressed":2445429,"data_compressed_allocated":22962176,"data_compressed_original":47398912,"omap_allocated":0,"internal_metadata":222101504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.529329"},"pg_stats":[{"pgid":"5.f","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.216143+0000","last_change":"2024-09-16T07:43:32.425787+0000","last_active":"2024-09-16T07:43:44.216143+0000","last_peered":"2024-09-16T07:43:44.216143+0000","last_clean":"2024-09-16T07:43:44.216143+0000","last_became_active":"2024-09-16T07:43:32.419042+0000","last_became_peered":"2024-09-16T07:43:32.419042+0000","last_unstale":"2024-09-16T07:43:44.216143+0000","last_undegraded":"2024-09-16T07:43:44.216143+0000","last_fullsized":"2024-09-16T07:43:44.216143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.150411+0000","last_change":"2024-09-16T07:43:32.475761+0000","last_active":"2024-09-16T07:43:44.150411+0000","last_peered":"2024-09-16T07:43:44.150411+0000","last_clean":"2024-09-16T07:43:44.150411+0000","last_became_active":"2024-09-16T07:43:32.466010+0000","last_became_peered":"2024-09-16T07:43:32.466010+0000","last_unstale":"2024-09-16T07:43:44.150411+0000","last_undegraded":"2024-09-16T07:43:44.150411+0000","last_fullsized":"2024-09-16T07:43:44.150411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"37'168","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.692636+0000","last_change":"2024-09-16T07:43:32.446194+0000","last_active":"2024-09-16T07:43:44.692636+0000","last_peered":"2024-09-16T07:43:44.692636+0000","last_clean":"2024-09-16T07:43:44.692636+0000","last_became_active":"2024-09-16T07:43:32.430490+0000","last_became_peered":"2024-09-16T07:43:32.430490+0000","last_unstale":"2024-09-16T07:43:44.692636+0000","last_undegraded":"2024-09-16T07:43:44.692636+0000","last_fullsized":"2024-09-16T07:43:44.692636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"37'87","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.746580+0000","last_change":"2024-09-16T07:43:32.475327+0000","last_active":"2024-09-16T07:43:44.746580+0000","last_peered":"2024-09-16T07:43:44.746580+0000","last_clean":"2024-09-16T07:43:44.746580+0000","last_became_active":"2024-09-16T07:43:32.468309+0000","last_became_peered":"2024-09-16T07:43:32.468309+0000","last_unstale":"2024-09-16T07:43:44.746580+0000","last_undegraded":"2024-09-16T07:43:44.746580+0000","last_fullsized":"2024-09-16T07:43:44.746580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712704,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'160","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.646000+0000","last_change":"2024-09-16T07:43:32.417052+0000","last_active":"2024-09-16T07:43:44.646000+0000","last_peered":"2024-09-16T07:43:44.646000+0000","last_clean":"2024-09-16T07:43:44.646000+0000","last_became_active":"2024-09-16T07:43:32.410819+0000","last_became_peered":"2024-09-16T07:43:32.410819+0000","last_unstale":"2024-09-16T07:43:44.646000+0000","last_undegraded":"2024-09-16T07:43:44.646000+0000","last_fullsized":"2024-09-16T07:43:44.646000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"37'104","reported_seq":116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.520036+0000","last_change":"2024-09-16T07:43:32.441596+0000","last_active":"2024-09-16T07:43:44.520036+0000","last_peered":"2024-09-16T07:43:44.520036+0000","last_clean":"2024-09-16T07:43:44.520036+0000","last_became_active":"2024-09-16T07:43:32.421884+0000","last_became_peered":"2024-09-16T07:43:32.421884+0000","last_unstale":"2024-09-16T07:43:44.520036+0000","last_undegraded":"2024-09-16T07:43:44.520036+0000","last_fullsized":"2024-09-16T07:43:44.520036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.532943+0000","last_change":"2024-09-16T07:43:32.406511+0000","last_active":"2024-09-16T07:43:43.532943+0000","last_peered":"2024-09-16T07:43:43.532943+0000","last_clean":"2024-09-16T07:43:43.532943+0000","last_became_active":"2024-09-16T07:43:32.393311+0000","last_became_peered":"2024-09-16T07:43:32.393311+0000","last_unstale":"2024-09-16T07:43:43.532943+0000","last_undegraded":"2024-09-16T07:43:43.532943+0000","last_fullsized":"2024-09-16T07:43:43.532943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"37'96","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:40.904425+0000","last_change":"2024-09-16T07:43:32.405182+0000","last_active":"2024-09-16T07:43:40.904425+0000","last_peered":"2024-09-16T07:43:40.904425+0000","last_clean":"2024-09-16T07:43:40.904425+0000","last_became_active":"2024-09-16T07:43:32.392235+0000","last_became_peered":"2024-09-16T07:43:32.392235+0000","last_unstale":"2024-09-16T07:43:40.904425+0000","last_undegraded":"2024-09-16T07:43:40.904425+0000","last_fullsized":"2024-09-16T07:43:40.904425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"37'144","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.539748+0000","last_change":"2024-09-16T07:43:32.434476+0000","last_active":"2024-09-16T07:43:43.539748+0000","last_peered":"2024-09-16T07:43:43.539748+0000","last_clean":"2024-09-16T07:43:43.539748+0000","last_became_active":"2024-09-16T07:43:32.411780+0000","last_became_peered":"2024-09-16T07:43:32.411780+0000","last_unstale":"2024-09-16T07:43:43.539748+0000","last_undegraded":"2024-09-16T07:43:43.539748+0000","last_fullsized":"2024-09-16T07:43:43.539748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":154,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.296684+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:43:33.296684+0000","last_peered":"2024-09-16T07:43:33.296684+0000","last_clean":"2024-09-16T07:43:33.296684+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:43:33.296684+0000","last_undegraded":"2024-09-16T07:43:33.296684+0000","last_fullsized":"2024-09-16T07:43:33.296684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.302145+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:43:33.302145+0000","last_peered":"2024-09-16T07:43:33.302145+0000","last_clean":"2024-09-16T07:43:33.302145+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:43:33.302145+0000","last_undegraded":"2024-09-16T07:43:33.302145+0000","last_fullsized":"2024-09-16T07:43:33.302145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.976241+0000","last_change":"2024-09-16T07:43:32.424957+0000","last_active":"2024-09-16T07:43:43.976241+0000","last_peered":"2024-09-16T07:43:43.976241+0000","last_clean":"2024-09-16T07:43:43.976241+0000","last_became_active":"2024-09-16T07:43:32.416782+0000","last_became_peered":"2024-09-16T07:43:32.416782+0000","last_unstale":"2024-09-16T07:43:43.976241+0000","last_undegraded":"2024-09-16T07:43:43.976241+0000","last_fullsized":"2024-09-16T07:43:43.976241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.297962+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:43:33.297962+0000","last_peered":"2024-09-16T07:43:33.297962+0000","last_clean":"2024-09-16T07:43:33.297962+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:43:33.297962+0000","last_undegraded":"2024-09-16T07:43:33.297962+0000","last_fullsized":"2024-09-16T07:43:33.297962+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.390855+0000","last_change":"2024-09-16T07:43:32.400263+0000","last_active":"2024-09-16T07:43:44.390855+0000","last_peered":"2024-09-16T07:43:44.390855+0000","last_clean":"2024-09-16T07:43:44.390855+0000","last_became_active":"2024-09-16T07:43:32.392833+0000","last_became_peered":"2024-09-16T07:43:32.392833+0000","last_unstale":"2024-09-16T07:43:44.390855+0000","last_undegraded":"2024-09-16T07:43:44.390855+0000","last_fullsized":"2024-09-16T07:43:44.390855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.301052+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:43:33.301052+0000","last_peered":"2024-09-16T07:43:33.301052+0000","last_clean":"2024-09-16T07:43:33.301052+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:43:33.301052+0000","last_undegraded":"2024-09-16T07:43:33.301052+0000","last_fullsized":"2024-09-16T07:43:33.301052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'123","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.752354+0000","last_change":"2024-09-16T07:43:32.466109+0000","last_active":"2024-09-16T07:43:44.752354+0000","last_peered":"2024-09-16T07:43:44.752354+0000","last_clean":"2024-09-16T07:43:44.752354+0000","last_became_active":"2024-09-16T07:43:32.455735+0000","last_became_peered":"2024-09-16T07:43:32.455735+0000","last_unstale":"2024-09-16T07:43:44.752354+0000","last_undegraded":"2024-09-16T07:43:44.752354+0000","last_fullsized":"2024-09-16T07:43:44.752354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1007616,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.303034+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:43:33.303034+0000","last_peered":"2024-09-16T07:43:33.303034+0000","last_clean":"2024-09-16T07:43:33.303034+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:43:33.303034+0000","last_undegraded":"2024-09-16T07:43:33.303034+0000","last_fullsized":"2024-09-16T07:43:33.303034+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"37'152","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:42.010616+0000","last_change":"2024-09-16T07:43:32.461294+0000","last_active":"2024-09-16T07:43:42.010616+0000","last_peered":"2024-09-16T07:43:42.010616+0000","last_clean":"2024-09-16T07:43:42.010616+0000","last_became_active":"2024-09-16T07:43:32.449642+0000","last_became_peered":"2024-09-16T07:43:32.449642+0000","last_unstale":"2024-09-16T07:43:42.010616+0000","last_undegraded":"2024-09-16T07:43:42.010616+0000","last_fullsized":"2024-09-16T07:43:42.010616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.307354+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:43:33.307354+0000","last_peered":"2024-09-16T07:43:33.307354+0000","last_clean":"2024-09-16T07:43:33.307354+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:43:33.307354+0000","last_undegraded":"2024-09-16T07:43:33.307354+0000","last_fullsized":"2024-09-16T07:43:33.307354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"37'132","reported_seq":144,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.747596+0000","last_change":"2024-09-16T07:43:32.403022+0000","last_active":"2024-09-16T07:43:44.747596+0000","last_peered":"2024-09-16T07:43:44.747596+0000","last_clean":"2024-09-16T07:43:44.747596+0000","last_became_active":"2024-09-16T07:43:32.387358+0000","last_became_peered":"2024-09-16T07:43:32.387358+0000","last_unstale":"2024-09-16T07:43:44.747596+0000","last_undegraded":"2024-09-16T07:43:44.747596+0000","last_fullsized":"2024-09-16T07:43:44.747596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.304078+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:43:33.304078+0000","last_peered":"2024-09-16T07:43:33.304078+0000","last_clean":"2024-09-16T07:43:33.304078+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:43:33.304078+0000","last_undegraded":"2024-09-16T07:43:33.304078+0000","last_fullsized":"2024-09-16T07:43:33.304078+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.066154+0000","last_change":"2024-09-16T07:43:32.439788+0000","last_active":"2024-09-16T07:43:43.066154+0000","last_peered":"2024-09-16T07:43:43.066154+0000","last_clean":"2024-09-16T07:43:43.066154+0000","last_became_active":"2024-09-16T07:43:32.430373+0000","last_became_peered":"2024-09-16T07:43:32.430373+0000","last_unstale":"2024-09-16T07:43:43.066154+0000","last_undegraded":"2024-09-16T07:43:43.066154+0000","last_fullsized":"2024-09-16T07:43:43.066154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.299842+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:43:33.299842+0000","last_peered":"2024-09-16T07:43:33.299842+0000","last_clean":"2024-09-16T07:43:33.299842+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:43:33.299842+0000","last_undegraded":"2024-09-16T07:43:33.299842+0000","last_fullsized":"2024-09-16T07:43:33.299842+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"37'88","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.455907+0000","last_change":"2024-09-16T07:43:32.470686+0000","last_active":"2024-09-16T07:43:44.455907+0000","last_peered":"2024-09-16T07:43:44.455907+0000","last_clean":"2024-09-16T07:43:44.455907+0000","last_became_active":"2024-09-16T07:43:32.463473+0000","last_became_peered":"2024-09-16T07:43:32.463473+0000","last_unstale":"2024-09-16T07:43:44.455907+0000","last_undegraded":"2024-09-16T07:43:44.455907+0000","last_fullsized":"2024-09-16T07:43:44.455907+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.295667+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:43:33.295667+0000","last_peered":"2024-09-16T07:43:33.295667+0000","last_clean":"2024-09-16T07:43:33.295667+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:43:33.295667+0000","last_undegraded":"2024-09-16T07:43:33.295667+0000","last_fullsized":"2024-09-16T07:43:33.295667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":16302080,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":15920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24453120,"data_stored":48906240,"data_compressed":2521980,"data_compressed_allocated":24453120,"data_compressed_original":48906240,"omap_allocated":0,"internal_metadata":0},"log_size":1990,"ondisk_log_size":1990,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63504,"kb_used_data":6144,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94308336,"statfs":{"total":96636764160,"available":96571736064,"internally_reserved":0,"allocated":6291456,"data_stored":12053517,"data_compressed":615864,"data_compressed_allocated":5971968,"data_compressed_original":11943936,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59048,"kb_used_data":5844,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312792,"statfs":{"total":96636764160,"available":96576299008,"internally_reserved":0,"allocated":5984256,"data_stored":11906605,"data_compressed":607893,"data_compressed_allocated":5644288,"data_compressed_original":11780096,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53952,"kb_used_data":4912,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94317888,"statfs":{"total":96636764160,"available":96581517312,"internally_reserved":0,"allocated":5029888,"data_stored":9997869,"data_compressed":509440,"data_compressed_allocated":4689920,"data_compressed_original":9871360,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64188,"kb_used_data":6828,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307652,"statfs":{"total":96636764160,"available":96571035648,"internally_reserved":0,"allocated":6991872,"data_stored":13930010,"data_compressed":712232,"data_compressed_allocated":6656000,"data_compressed_original":13803520,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":14393344,"data_compressed":742261,"data_compressed_allocated":7196672,"data_compressed_original":14393344,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":9773056,"data_compressed":503937,"data_compressed_allocated":4886528,"data_compressed_original":9773056,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6017024,"data_stored":12034048,"data_compressed":620579,"data_compressed_allocated":6017024,"data_compressed_original":12034048,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":12705792,"data_compressed":655203,"data_compressed_allocated":6352896,"data_compressed_original":12705792,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:44:01.176 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:44:01.177 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:01.177 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:01.177 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:01.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:01.320+0000 7f75f0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:01.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:01.331+0000 7f75f0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:01.352 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:01.352 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:01.352 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:01.352 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:01.352 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:01.352 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:01.352 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:01.352 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:01.353 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:01.353 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:01.353 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:01.353 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:01.355 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:01.356 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:01.356 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:01.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 28 16 4668 4652 1.29787 1.21875 0.147734 0.0961851 2024-09-16T07:44:01.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:01.497+0000 7f9aa0a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:01.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:01.511+0000 7f9aa0a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:01.692 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:01.693 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:01.695 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:01.695 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:01.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:01.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:01.853+0000 7fed58d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:01.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:01.867+0000 7fed58d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:01.895 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:01.895 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:01.895 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:01.895 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:01.895 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:01.895 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:01.895 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:01.895 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:01.896 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:01.896 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:01.896 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:01.896 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:01.901 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:01.901 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:01.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:44:02.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:02.027+0000 7feb6c8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:02.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:02.038+0000 7feb6c8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:02.062 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:02.063 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:02.063 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:02.063 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:02.063 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:02.067 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:02.067 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:02.299 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:02.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 29 16 4832 4816 1.29729 1.28125 0.0580761 0.0961994 2024-09-16T07:44:02.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:02.435+0000 7f679d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:02.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:02.443+0000 7f679d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:03.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 30 16 4999 4983 1.29753 1.30469 0.11549 0.0960654 2024-09-16T07:44:04.370 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 31 16 5166 5150 1.29776 1.30469 0.137878 0.0962461 2024-09-16T07:44:04.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:04.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:04.882+0000 7f1b034fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:04.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:04.892+0000 7f1b034fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:05.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 32 16 5321 5305 1.29505 1.21094 0.077345 0.0963127 2024-09-16T07:44:06.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 33 16 5482 5466 1.29391 1.25781 0.103437 0.096348 2024-09-16T07:44:07.068 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:07.068 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:07.068 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:07.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:07.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.207+0000 7f525d27d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.218+0000 7f525d27d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:07.255 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:07.259 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:07.260 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:07.260 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:07.293 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:07.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 34 16 5640 5624 1.29216 1.23438 0.192515 0.0964266 2024-09-16T07:44:07.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.391+0000 7f802ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.410+0000 7f802ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.422+0000 7f8b4af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.430+0000 7f8b4af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:07.482 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:07.483 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:07.483 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:07.483 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:07.486 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:07.487 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:07.487 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.631+0000 7f208dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.643+0000 7f208dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:07.672 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:07.673 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:07.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:44:07.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.789+0000 7f145749c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:07.799+0000 7f145749c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:07.865 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:07.865 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:07.865 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:07.865 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:07.865 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:07.865 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:07.865 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:07.865 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:07.866 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:07.866 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:07.866 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:07.866 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:07.869 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:07.870 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:08.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 35 16 5805 5789 1.29207 1.28906 0.073814 0.0966524 2024-09-16T07:44:09.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 36 16 5979 5963 1.29393 1.35938 0.100923 0.0964783 2024-09-16T07:44:09.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:09.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:09.807+0000 7fb99524f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:09.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:09.815+0000 7fb99524f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:10.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 37 16 6162 6146 1.2976 1.42969 0.064626 0.096179 2024-09-16T07:44:11.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 38 16 6338 6322 1.29963 1.375 0.0900814 0.0960659 2024-09-16T07:44:12.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:12.361+0000 7f15956ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:12.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:12.369+0000 7f15956ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:12.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 39 15 6480 6465 1.29495 1.11719 0.0780669 0.0964114 2024-09-16T07:44:12.870 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:12.871 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:12.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:44:13.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:13.019+0000 7fbb7bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:13.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:13.033+0000 7fbb7bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:13.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:44:13.373194+0000 min lat: 0.0143729 max lat: 0.26471 avg lat: 0.0967501 2024-09-16T07:44:13.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:44:13.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 40 16 6622 6606 1.29011 1.10156 0.126917 0.0967501 2024-09-16T07:44:13.405 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:44:13.405 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:44:13.425 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-16T07:44:11.747633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16892467,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2071,"num_write_kb":17028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2045,"ondisk_log_size":2045,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":240692,"kb_used_data":23728,"kb_used_omap":0,"kb_used_meta":216896,"kb_avail":377246668,"statfs":{"total":386547056640,"available":386300588032,"internally_reserved":0,"allocated":24297472,"data_stored":47888001,"data_compressed":2445429,"data_compressed_allocated":22962176,"data_compressed_original":47398912,"omap_allocated":0,"internal_metadata":222101504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.473750"},"pg_stats":[{"pgid":"5.f","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.216143+0000","last_change":"2024-09-16T07:43:32.425787+0000","last_active":"2024-09-16T07:43:44.216143+0000","last_peered":"2024-09-16T07:43:44.216143+0000","last_clean":"2024-09-16T07:43:44.216143+0000","last_became_active":"2024-09-16T07:43:32.419042+0000","last_became_peered":"2024-09-16T07:43:32.419042+0000","last_unstale":"2024-09-16T07:43:44.216143+0000","last_undegraded":"2024-09-16T07:43:44.216143+0000","last_fullsized":"2024-09-16T07:43:44.216143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.150411+0000","last_change":"2024-09-16T07:43:32.475761+0000","last_active":"2024-09-16T07:43:44.150411+0000","last_peered":"2024-09-16T07:43:44.150411+0000","last_clean":"2024-09-16T07:43:44.150411+0000","last_became_active":"2024-09-16T07:43:32.466010+0000","last_became_peered":"2024-09-16T07:43:32.466010+0000","last_unstale":"2024-09-16T07:43:44.150411+0000","last_undegraded":"2024-09-16T07:43:44.150411+0000","last_fullsized":"2024-09-16T07:43:44.150411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"37'168","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.692636+0000","last_change":"2024-09-16T07:43:32.446194+0000","last_active":"2024-09-16T07:43:44.692636+0000","last_peered":"2024-09-16T07:43:44.692636+0000","last_clean":"2024-09-16T07:43:44.692636+0000","last_became_active":"2024-09-16T07:43:32.430490+0000","last_became_peered":"2024-09-16T07:43:32.430490+0000","last_unstale":"2024-09-16T07:43:44.692636+0000","last_undegraded":"2024-09-16T07:43:44.692636+0000","last_fullsized":"2024-09-16T07:43:44.692636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"37'87","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.746580+0000","last_change":"2024-09-16T07:43:32.475327+0000","last_active":"2024-09-16T07:43:44.746580+0000","last_peered":"2024-09-16T07:43:44.746580+0000","last_clean":"2024-09-16T07:43:44.746580+0000","last_became_active":"2024-09-16T07:43:32.468309+0000","last_became_peered":"2024-09-16T07:43:32.468309+0000","last_unstale":"2024-09-16T07:43:44.746580+0000","last_undegraded":"2024-09-16T07:43:44.746580+0000","last_fullsized":"2024-09-16T07:43:44.746580+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":712704,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"37'160","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.646000+0000","last_change":"2024-09-16T07:43:32.417052+0000","last_active":"2024-09-16T07:43:44.646000+0000","last_peered":"2024-09-16T07:43:44.646000+0000","last_clean":"2024-09-16T07:43:44.646000+0000","last_became_active":"2024-09-16T07:43:32.410819+0000","last_became_peered":"2024-09-16T07:43:32.410819+0000","last_unstale":"2024-09-16T07:43:44.646000+0000","last_undegraded":"2024-09-16T07:43:44.646000+0000","last_fullsized":"2024-09-16T07:43:44.646000+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"37'104","reported_seq":116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.520036+0000","last_change":"2024-09-16T07:43:32.441596+0000","last_active":"2024-09-16T07:43:44.520036+0000","last_peered":"2024-09-16T07:43:44.520036+0000","last_clean":"2024-09-16T07:43:44.520036+0000","last_became_active":"2024-09-16T07:43:32.421884+0000","last_became_peered":"2024-09-16T07:43:32.421884+0000","last_unstale":"2024-09-16T07:43:44.520036+0000","last_undegraded":"2024-09-16T07:43:44.520036+0000","last_fullsized":"2024-09-16T07:43:44.520036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"37'136","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.532943+0000","last_change":"2024-09-16T07:43:32.406511+0000","last_active":"2024-09-16T07:43:43.532943+0000","last_peered":"2024-09-16T07:43:43.532943+0000","last_clean":"2024-09-16T07:43:43.532943+0000","last_became_active":"2024-09-16T07:43:32.393311+0000","last_became_peered":"2024-09-16T07:43:32.393311+0000","last_unstale":"2024-09-16T07:43:43.532943+0000","last_undegraded":"2024-09-16T07:43:43.532943+0000","last_fullsized":"2024-09-16T07:43:43.532943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"37'96","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:40.904425+0000","last_change":"2024-09-16T07:43:32.405182+0000","last_active":"2024-09-16T07:43:40.904425+0000","last_peered":"2024-09-16T07:43:40.904425+0000","last_clean":"2024-09-16T07:43:40.904425+0000","last_became_active":"2024-09-16T07:43:32.392235+0000","last_became_peered":"2024-09-16T07:43:32.392235+0000","last_unstale":"2024-09-16T07:43:40.904425+0000","last_undegraded":"2024-09-16T07:43:40.904425+0000","last_fullsized":"2024-09-16T07:43:40.904425+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"37'144","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.539748+0000","last_change":"2024-09-16T07:43:32.434476+0000","last_active":"2024-09-16T07:43:43.539748+0000","last_peered":"2024-09-16T07:43:43.539748+0000","last_clean":"2024-09-16T07:43:43.539748+0000","last_became_active":"2024-09-16T07:43:32.411780+0000","last_became_peered":"2024-09-16T07:43:32.411780+0000","last_unstale":"2024-09-16T07:43:43.539748+0000","last_undegraded":"2024-09-16T07:43:43.539748+0000","last_fullsized":"2024-09-16T07:43:43.539748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":154,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.296684+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:43:33.296684+0000","last_peered":"2024-09-16T07:43:33.296684+0000","last_clean":"2024-09-16T07:43:33.296684+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:43:33.296684+0000","last_undegraded":"2024-09-16T07:43:33.296684+0000","last_fullsized":"2024-09-16T07:43:33.296684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.302145+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:43:33.302145+0000","last_peered":"2024-09-16T07:43:33.302145+0000","last_clean":"2024-09-16T07:43:33.302145+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:43:33.302145+0000","last_undegraded":"2024-09-16T07:43:33.302145+0000","last_fullsized":"2024-09-16T07:43:33.302145+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.976241+0000","last_change":"2024-09-16T07:43:32.424957+0000","last_active":"2024-09-16T07:43:43.976241+0000","last_peered":"2024-09-16T07:43:43.976241+0000","last_clean":"2024-09-16T07:43:43.976241+0000","last_became_active":"2024-09-16T07:43:32.416782+0000","last_became_peered":"2024-09-16T07:43:32.416782+0000","last_unstale":"2024-09-16T07:43:43.976241+0000","last_undegraded":"2024-09-16T07:43:43.976241+0000","last_fullsized":"2024-09-16T07:43:43.976241+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.297962+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:43:33.297962+0000","last_peered":"2024-09-16T07:43:33.297962+0000","last_clean":"2024-09-16T07:43:33.297962+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:43:33.297962+0000","last_undegraded":"2024-09-16T07:43:33.297962+0000","last_fullsized":"2024-09-16T07:43:33.297962+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"37'112","reported_seq":124,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.390855+0000","last_change":"2024-09-16T07:43:32.400263+0000","last_active":"2024-09-16T07:43:44.390855+0000","last_peered":"2024-09-16T07:43:44.390855+0000","last_clean":"2024-09-16T07:43:44.390855+0000","last_became_active":"2024-09-16T07:43:32.392833+0000","last_became_peered":"2024-09-16T07:43:32.392833+0000","last_unstale":"2024-09-16T07:43:44.390855+0000","last_undegraded":"2024-09-16T07:43:44.390855+0000","last_fullsized":"2024-09-16T07:43:44.390855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.301052+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:43:33.301052+0000","last_peered":"2024-09-16T07:43:33.301052+0000","last_clean":"2024-09-16T07:43:33.301052+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:43:33.301052+0000","last_undegraded":"2024-09-16T07:43:33.301052+0000","last_fullsized":"2024-09-16T07:43:33.301052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'123","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.752354+0000","last_change":"2024-09-16T07:43:32.466109+0000","last_active":"2024-09-16T07:43:44.752354+0000","last_peered":"2024-09-16T07:43:44.752354+0000","last_clean":"2024-09-16T07:43:44.752354+0000","last_became_active":"2024-09-16T07:43:32.455735+0000","last_became_peered":"2024-09-16T07:43:32.455735+0000","last_unstale":"2024-09-16T07:43:44.752354+0000","last_undegraded":"2024-09-16T07:43:44.752354+0000","last_fullsized":"2024-09-16T07:43:44.752354+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1007616,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.303034+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:43:33.303034+0000","last_peered":"2024-09-16T07:43:33.303034+0000","last_clean":"2024-09-16T07:43:33.303034+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:43:33.303034+0000","last_undegraded":"2024-09-16T07:43:33.303034+0000","last_fullsized":"2024-09-16T07:43:33.303034+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"37'152","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:42.010616+0000","last_change":"2024-09-16T07:43:32.461294+0000","last_active":"2024-09-16T07:43:42.010616+0000","last_peered":"2024-09-16T07:43:42.010616+0000","last_clean":"2024-09-16T07:43:42.010616+0000","last_became_active":"2024-09-16T07:43:32.449642+0000","last_became_peered":"2024-09-16T07:43:32.449642+0000","last_unstale":"2024-09-16T07:43:42.010616+0000","last_undegraded":"2024-09-16T07:43:42.010616+0000","last_fullsized":"2024-09-16T07:43:42.010616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.307354+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:43:33.307354+0000","last_peered":"2024-09-16T07:43:33.307354+0000","last_clean":"2024-09-16T07:43:33.307354+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:43:33.307354+0000","last_undegraded":"2024-09-16T07:43:33.307354+0000","last_fullsized":"2024-09-16T07:43:33.307354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"37'132","reported_seq":144,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.747596+0000","last_change":"2024-09-16T07:43:32.403022+0000","last_active":"2024-09-16T07:43:44.747596+0000","last_peered":"2024-09-16T07:43:44.747596+0000","last_clean":"2024-09-16T07:43:44.747596+0000","last_became_active":"2024-09-16T07:43:32.387358+0000","last_became_peered":"2024-09-16T07:43:32.387358+0000","last_unstale":"2024-09-16T07:43:44.747596+0000","last_undegraded":"2024-09-16T07:43:44.747596+0000","last_fullsized":"2024-09-16T07:43:44.747596+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081344,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":1056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.304078+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:43:33.304078+0000","last_peered":"2024-09-16T07:43:33.304078+0000","last_clean":"2024-09-16T07:43:33.304078+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:43:33.304078+0000","last_undegraded":"2024-09-16T07:43:33.304078+0000","last_fullsized":"2024-09-16T07:43:33.304078+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"37'120","reported_seq":132,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:43.066154+0000","last_change":"2024-09-16T07:43:32.439788+0000","last_active":"2024-09-16T07:43:43.066154+0000","last_peered":"2024-09-16T07:43:43.066154+0000","last_clean":"2024-09-16T07:43:43.066154+0000","last_became_active":"2024-09-16T07:43:32.430373+0000","last_became_peered":"2024-09-16T07:43:32.430373+0000","last_unstale":"2024-09-16T07:43:43.066154+0000","last_undegraded":"2024-09-16T07:43:43.066154+0000","last_fullsized":"2024-09-16T07:43:43.066154+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.299842+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:43:33.299842+0000","last_peered":"2024-09-16T07:43:33.299842+0000","last_clean":"2024-09-16T07:43:33.299842+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:43:33.299842+0000","last_undegraded":"2024-09-16T07:43:33.299842+0000","last_fullsized":"2024-09-16T07:43:33.299842+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"37'88","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:44.455907+0000","last_change":"2024-09-16T07:43:32.470686+0000","last_active":"2024-09-16T07:43:44.455907+0000","last_peered":"2024-09-16T07:43:44.455907+0000","last_clean":"2024-09-16T07:43:44.455907+0000","last_became_active":"2024-09-16T07:43:32.463473+0000","last_became_peered":"2024-09-16T07:43:32.463473+0000","last_unstale":"2024-09-16T07:43:44.455907+0000","last_undegraded":"2024-09-16T07:43:44.455907+0000","last_fullsized":"2024-09-16T07:43:44.455907+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-16T07:43:33.295667+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:43:33.295667+0000","last_peered":"2024-09-16T07:43:33.295667+0000","last_clean":"2024-09-16T07:43:33.295667+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:43:33.295667+0000","last_undegraded":"2024-09-16T07:43:33.295667+0000","last_fullsized":"2024-09-16T07:43:33.295667+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":16302080,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1990,"num_write_kb":15920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24453120,"data_stored":48906240,"data_compressed":2521980,"data_compressed_allocated":24453120,"data_compressed_original":48906240,"omap_allocated":0,"internal_metadata":0},"log_size":1990,"ondisk_log_size":1990,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63504,"kb_used_data":6144,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94308336,"statfs":{"total":96636764160,"available":96571736064,"internally_reserved":0,"allocated":6291456,"data_stored":12053517,"data_compressed":615864,"data_compressed_allocated":5971968,"data_compressed_original":11943936,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59048,"kb_used_data":5844,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312792,"statfs":{"total":96636764160,"available":96576299008,"internally_reserved":0,"allocated":5984256,"data_stored":11906605,"data_compressed":607893,"data_compressed_allocated":5644288,"data_compressed_original":11780096,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53952,"kb_used_data":4912,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94317888,"statfs":{"total":96636764160,"available":96581517312,"internally_reserved":0,"allocated":5029888,"data_stored":9997869,"data_compressed":509440,"data_compressed_allocated":4689920,"data_compressed_original":9871360,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64188,"kb_used_data":6828,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307652,"statfs":{"total":96636764160,"available":96571035648,"internally_reserved":0,"allocated":6991872,"data_stored":13930010,"data_compressed":712232,"data_compressed_allocated":6656000,"data_compressed_original":13803520,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7196672,"data_stored":14393344,"data_compressed":742261,"data_compressed_allocated":7196672,"data_compressed_original":14393344,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4886528,"data_stored":9773056,"data_compressed":503937,"data_compressed_allocated":4886528,"data_compressed_original":9773056,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6017024,"data_stored":12034048,"data_compressed":620579,"data_compressed_allocated":6017024,"data_compressed_original":12034048,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":12705792,"data_compressed":655203,"data_compressed_allocated":6352896,"data_compressed_original":12705792,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:44:14.371 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 41 16 6779 6763 1.28856 1.22656 0.162022 0.0967417 2024-09-16T07:44:14.676 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:14.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:14.832+0000 7f0358591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:14.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:14.837+0000 7f0358591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:15.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 42 16 6947 6931 1.28913 1.3125 0.147576 0.0968365 2024-09-16T07:44:16.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 43 16 7096 7080 1.28622 1.16406 0.13647 0.0970193 2024-09-16T07:44:16.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:17.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:17.106+0000 7ff8a1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:17.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:17.114+0000 7ff8a1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:17.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 44 15 7268 7253 1.2877 1.35156 0.0914337 0.0969598 2024-09-16T07:44:18.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 45 16 7424 7408 1.28599 1.21094 0.0933788 0.0970682 2024-09-16T07:44:18.428 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:18.428 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:18.428 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:18.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:18.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:18.584+0000 7f5b6f511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:18.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:18.596+0000 7f5b6f511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:18.626 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:18.626 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:18.627 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:18.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:18.754+0000 7f450827f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:18.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:18.766+0000 7f450827f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:18.880 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:18.881 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:18.884 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:18.884 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:18.884 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:19.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:19.020+0000 7f2bf3ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:19.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:19.030+0000 7f2bf3ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:19.182 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:19.183 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:19.183 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:19.186 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:19.186 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:19.186 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:44:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:19.321+0000 7f1f63991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:19.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:19.333+0000 7f1f63991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:19.369 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:19.369 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:19.369 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:19.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 46 16 7572 7556 1.28317 1.15625 0.0905383 0.0973145 2024-09-16T07:44:19.372 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:19.373 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:19.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:19.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:19.622+0000 7fef32b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:19.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:19.631+0000 7fef32b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:20.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 47 16 7719 7703 1.2803 1.14844 0.076932 0.0975501 2024-09-16T07:44:21.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 48 16 7865 7849 1.27739 1.14062 0.190257 0.0975987 2024-09-16T07:44:21.967 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:22.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:22.088+0000 7f69590a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:22.095+0000 7f69590a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:22.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 49 16 8011 7995 1.27459 1.14062 0.186603 0.0978946 2024-09-16T07:44:23.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 50 16 8167 8151 1.27347 1.21875 0.135694 0.0979817 2024-09-16T07:44:24.357 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:24.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 51 16 8313 8297 1.27087 1.14062 0.133774 0.0982011 2024-09-16T07:44:24.374 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:24.374 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:24.374 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:24.374 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:24.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:24.495+0000 7fedbdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:24.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:24.502+0000 7fedbdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:24.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:24.535+0000 7f892e888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:24.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:24.551+0000 7f892e888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:24.636 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:24.636 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:24.637 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:24.640 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:24.640 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:24.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:24.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:24.782+0000 7fa748e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:24.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:24.793+0000 7fa748e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:24.809 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:24.810 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:24.810 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:24.812 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:24.812 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:24.812 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:24.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:24.941+0000 7fb33d223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:24.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:24.956+0000 7fb33d223640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:25.072 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:25.072 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:25.073 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:25.074 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:25.074 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:25.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:44:25.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:25.244+0000 7f46a96ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:25.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:25.254+0000 7f46a96ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:25.280 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:25.283 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:25.284 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:25.372 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 52 16 8463 8447 1.26896 1.17188 0.0896403 0.0984009 2024-09-16T07:44:26.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 53 16 8616 8600 1.26757 1.19531 0.0754786 0.0985144 2024-09-16T07:44:26.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:27.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:27.051+0000 7f35a84c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:27.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:27.058+0000 7f35a84c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:27.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 54 16 8771 8755 1.26652 1.21094 0.0913103 0.0986639 2024-09-16T07:44:28.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 55 16 8892 8876 1.26068 0.945312 0.039393 0.0989639 2024-09-16T07:44:29.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 56 16 9052 9036 1.26048 1.25 0.146799 0.0990324 2024-09-16T07:44:29.591 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:29.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:29.722+0000 7f2f6c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:29.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:29.729+0000 7f2f6c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:30.285 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:30.285 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:30.285 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:30.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:30.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 57 16 9216 9200 1.26085 1.28125 0.0942621 0.0990585 2024-09-16T07:44:30.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:30.437+0000 7f35a7108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:30.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:30.449+0000 7f35a7108640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:30.597 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:30.597 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:30.597 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:30.597 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:30.597 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:30.597 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:30.597 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:30.598 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:30.598 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:30.598 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:30.598 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:30.598 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:30.604 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:30.604 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:30.605 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:30.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:30.741+0000 7f6354cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:30.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:30.752+0000 7f6354cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:30.886 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:30.886 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:30.886 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:30.886 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:30.887 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:30.887 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:30.887 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:30.887 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:30.887 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:30.887 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:30.887 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:30.887 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:30.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:30.890 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:30.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:31.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:31.015+0000 7fc1b1b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:31.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:31.029+0000 7fc1b1b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:31.107 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:31.107 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:31.107 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:31.107 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:31.107 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:31.108 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:31.108 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:31.108 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:31.108 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:31.108 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:31.108 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:31.108 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:31.111 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:31.112 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:31.112 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:44:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:31.247+0000 7fc955191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:31.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:31.261+0000 7fc955191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:31.371 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:31.371 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:31.371 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:31.371 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:31.371 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:31.372 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:31.372 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:31.372 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:31.372 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:31.372 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:31.372 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:31.372 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:31.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 58 16 9357 9341 1.2581 1.10156 0.180454 0.099228 2024-09-16T07:44:31.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:31.374 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:31.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:32.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:32.105+0000 7f0c08751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:32.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:32.112+0000 7f0c08751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:32.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 59 16 9484 9468 1.25359 0.992188 0.0813297 0.0996111 2024-09-16T07:44:33.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:44:33.375098+0000 min lat: 0.0143729 max lat: 0.327449 avg lat: 0.0997304 2024-09-16T07:44:33.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:44:33.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 60 15 9634 9619 1.25235 1.17969 0.0941339 0.0997304 2024-09-16T07:44:34.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 61 16 9782 9766 1.25065 1.14844 0.168992 0.0997958 2024-09-16T07:44:34.482 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:34.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:34.602+0000 7f8fed391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:34.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:34.609+0000 7f8fed391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:35.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 62 16 9927 9911 1.24875 1.13281 0.0689529 0.100014 2024-09-16T07:44:36.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 63 16 10069 10053 1.24653 1.10938 0.205533 0.100116 2024-09-16T07:44:36.375 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:36.375 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:36.375 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:36.375 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:36.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:36.507+0000 7f7755f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:36.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:36.519+0000 7f7755f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:36.541 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:36.541 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:36.541 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:36.541 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:36.541 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:36.541 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:36.541 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:36.542 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:36.542 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:36.542 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:36.542 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:36.542 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:36.544 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:36.544 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:36.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:36.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:36.669+0000 7fb4914a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:36.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:36.679+0000 7fb4914a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:36.720 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:36.723 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:36.723 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:36.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:36.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:36.850+0000 7f615d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:36.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:36.864+0000 7f615d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:36.933 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:36.933 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:36.933 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:36.933 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:36.933 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:36.933 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:36.936 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:36.937 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:36.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:44:37.001 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:37.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:37.090+0000 7fd1afb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:37.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:37.115+0000 7fd1afb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:37.143 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:37.144 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:37.145 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:37.149 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:37.149 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:37.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:37.158+0000 7fc621991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:37.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:37.169+0000 7fc621991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:37.373 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 64 16 10184 10168 1.24109 0.898438 0.149991 0.100567 2024-09-16T07:44:38.377 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 65 16 10337 10321 1.24039 1.19531 0.105444 0.100682 2024-09-16T07:44:39.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 66 16 10496 10480 1.24041 1.24219 0.10081 0.10062 2024-09-16T07:44:39.530 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:39.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:39.668+0000 7f03b88d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:39.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:39.675+0000 7f03b88d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:40.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 67 16 10648 10632 1.23962 1.1875 0.105583 0.100707 2024-09-16T07:44:41.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 68 16 10794 10778 1.23816 1.14062 0.120204 0.100831 2024-09-16T07:44:41.998 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:42.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.135+0000 7f1bfb29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.141+0000 7f1bfb29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.150 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:42.151 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:42.151 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:42.151 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:42.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.268+0000 7f7085391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.279+0000 7f7085391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:42.303 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:42.306 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:42.307 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:42.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:42.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 69 16 10922 10906 1.23471 1 0.0701289 0.101157 2024-09-16T07:44:42.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.457+0000 7f47e5111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.468+0000 7f47e5111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.491 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:42.492 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:42.496 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:42.496 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:42.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:42.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.613+0000 7f3258f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.622+0000 7f3258f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.671 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:42.671 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:42.671 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:42.671 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:42.671 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:42.671 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:42.671 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:42.671 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:42.672 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:42.672 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:42.672 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:42.672 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:42.674 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:42.674 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:42.674 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:44:42.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.794+0000 7f9e97311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:42.805+0000 7f9e97311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:42.825 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:42.828 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:42.828 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:43.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 70 16 11073 11057 1.23392 1.17969 0.0683431 0.101244 2024-09-16T07:44:44.333 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:44.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 71 16 11216 11200 1.23228 1.11719 0.154621 0.101293 2024-09-16T07:44:44.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:44.493+0000 7fcb01351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:44.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:44.503+0000 7fcb01351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:45.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 72 16 11369 11353 1.23176 1.19531 0.0472662 0.101406 2024-09-16T07:44:46.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 73 16 11524 11508 1.23148 1.21094 0.0853886 0.10144 2024-09-16T07:44:46.949 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:47.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:47.080+0000 7f0df4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:47.086+0000 7f0df4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:47.374 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 74 16 11660 11644 1.22919 1.0625 0.179294 0.101595 2024-09-16T07:44:47.829 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:47.829 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:47.829 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:47.829 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:47.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:47.961+0000 7fd08b751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:47.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:47.972+0000 7fd08b751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:47.995 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:47.995 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:47.996 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:47.999 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:47.999 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:47.999 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:48.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:48.134+0000 7fef94ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:48.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:48.148+0000 7fef94ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:48.329 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:48.330 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:48.332 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:48.333 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:48.333 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:48.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 75 16 11786 11770 1.22593 0.984375 0.221465 0.101769 2024-09-16T07:44:48.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:48.459+0000 7f38efd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:48.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:48.470+0000 7f38efd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:48.522 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:48.527 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:48.527 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:48.527 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:44:48.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:48.687+0000 7f212a511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:48.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:48.700+0000 7f212a511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:48.722 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:48.722 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:48.722 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:48.722 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:48.722 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:48.723 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:48.723 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:48.723 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:48.723 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:48.723 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:48.723 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:48.723 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:48.726 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:48.727 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:49.334 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:49.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 76 16 11936 11920 1.22521 1.17188 0.0793026 0.101951 2024-09-16T07:44:49.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:49.459+0000 7f2808d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:49.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:49.469+0000 7f2808d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:50.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 77 16 12082 12066 1.22411 1.14062 0.0229859 0.101983 2024-09-16T07:44:51.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 78 16 12223 12207 1.22254 1.10156 0.106626 0.102154 2024-09-16T07:44:51.663 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:51.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:51.808+0000 7f579ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:51.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:51.815+0000 7f579ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:52.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 79 16 12373 12357 1.2219 1.17188 0.131111 0.102147 2024-09-16T07:44:53.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:44:53.376937+0000 min lat: 0.0143729 max lat: 0.327449 avg lat: 0.102379 2024-09-16T07:44:53.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:44:53.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 80 16 12513 12497 1.2203 1.09375 0.0940797 0.102379 2024-09-16T07:44:53.727 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:53.728 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:53.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:44:53.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:53.869+0000 7f2b5bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:53.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:53.879+0000 7f2b5bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:54.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:54.153 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:44:54.153 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:44:54.178 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-09-16T07:44:53.755778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":92938803,"num_objects":1414,"num_object_clones":0,"num_object_copies":4242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":11354,"num_write_kb":91292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11328,"ondisk_log_size":11328,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":420792,"kb_used_data":135800,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377066568,"statfs":{"total":386547056640,"available":386116165632,"internally_reserved":0,"allocated":139059200,"data_stored":277201681,"data_compressed":14283504,"data_compressed_allocated":137592832,"data_compressed_original":276660224,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36265984,"num_objects":554,"num_object_clones":0,"num_object_copies":1662,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4427,"num_write_kb":35416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002298"},"pg_stats":[{"pgid":"5.f","version":"41'672","reported_seq":696,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:43.412636+0000","last_change":"2024-09-16T07:43:32.425787+0000","last_active":"2024-09-16T07:44:43.412636+0000","last_peered":"2024-09-16T07:44:43.412636+0000","last_clean":"2024-09-16T07:44:43.412636+0000","last_became_active":"2024-09-16T07:43:32.419042+0000","last_became_peered":"2024-09-16T07:43:32.419042+0000","last_unstale":"2024-09-16T07:44:43.412636+0000","last_undegraded":"2024-09-16T07:44:43.412636+0000","last_fullsized":"2024-09-16T07:44:43.412636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"41'640","reported_seq":664,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:42.560605+0000","last_change":"2024-09-16T07:43:32.475761+0000","last_active":"2024-09-16T07:44:42.560605+0000","last_peered":"2024-09-16T07:44:42.560605+0000","last_clean":"2024-09-16T07:44:42.560605+0000","last_became_active":"2024-09-16T07:43:32.466010+0000","last_became_peered":"2024-09-16T07:43:32.466010+0000","last_unstale":"2024-09-16T07:44:42.560605+0000","last_undegraded":"2024-09-16T07:44:42.560605+0000","last_fullsized":"2024-09-16T07:44:42.560605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"41'792","reported_seq":816,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.734185+0000","last_change":"2024-09-16T07:43:32.446194+0000","last_active":"2024-09-16T07:44:44.734185+0000","last_peered":"2024-09-16T07:44:44.734185+0000","last_clean":"2024-09-16T07:44:44.734185+0000","last_became_active":"2024-09-16T07:43:32.430490+0000","last_became_peered":"2024-09-16T07:43:32.430490+0000","last_unstale":"2024-09-16T07:44:44.734185+0000","last_undegraded":"2024-09-16T07:44:44.734185+0000","last_fullsized":"2024-09-16T07:44:44.734185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"41'720","reported_seq":744,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.479700+0000","last_change":"2024-09-16T07:43:32.475327+0000","last_active":"2024-09-16T07:44:44.479700+0000","last_peered":"2024-09-16T07:44:44.479700+0000","last_clean":"2024-09-16T07:44:44.479700+0000","last_became_active":"2024-09-16T07:43:32.468309+0000","last_became_peered":"2024-09-16T07:43:32.468309+0000","last_unstale":"2024-09-16T07:44:44.479700+0000","last_undegraded":"2024-09-16T07:44:44.479700+0000","last_fullsized":"2024-09-16T07:44:44.479700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'760","reported_seq":784,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.532199+0000","last_change":"2024-09-16T07:43:32.417052+0000","last_active":"2024-09-16T07:44:44.532199+0000","last_peered":"2024-09-16T07:44:44.532199+0000","last_clean":"2024-09-16T07:44:44.532199+0000","last_became_active":"2024-09-16T07:43:32.410819+0000","last_became_peered":"2024-09-16T07:43:32.410819+0000","last_unstale":"2024-09-16T07:44:44.532199+0000","last_undegraded":"2024-09-16T07:44:44.532199+0000","last_fullsized":"2024-09-16T07:44:44.532199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"41'729","reported_seq":753,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:41.647261+0000","last_change":"2024-09-16T07:43:32.441596+0000","last_active":"2024-09-16T07:44:41.647261+0000","last_peered":"2024-09-16T07:44:41.647261+0000","last_clean":"2024-09-16T07:44:41.647261+0000","last_became_active":"2024-09-16T07:43:32.421884+0000","last_became_peered":"2024-09-16T07:43:32.421884+0000","last_unstale":"2024-09-16T07:44:41.647261+0000","last_undegraded":"2024-09-16T07:44:41.647261+0000","last_fullsized":"2024-09-16T07:44:41.647261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5971968,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":5832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"41'600","reported_seq":624,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:42.436447+0000","last_change":"2024-09-16T07:43:32.406511+0000","last_active":"2024-09-16T07:44:42.436447+0000","last_peered":"2024-09-16T07:44:42.436447+0000","last_clean":"2024-09-16T07:44:42.436447+0000","last_became_active":"2024-09-16T07:43:32.393311+0000","last_became_peered":"2024-09-16T07:43:32.393311+0000","last_unstale":"2024-09-16T07:44:42.436447+0000","last_undegraded":"2024-09-16T07:44:42.436447+0000","last_fullsized":"2024-09-16T07:44:42.436447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"41'728","reported_seq":752,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.596089+0000","last_change":"2024-09-16T07:43:32.405182+0000","last_active":"2024-09-16T07:44:44.596089+0000","last_peered":"2024-09-16T07:44:44.596089+0000","last_clean":"2024-09-16T07:44:44.596089+0000","last_became_active":"2024-09-16T07:43:32.392235+0000","last_became_peered":"2024-09-16T07:43:32.392235+0000","last_unstale":"2024-09-16T07:44:44.596089+0000","last_undegraded":"2024-09-16T07:44:44.596089+0000","last_fullsized":"2024-09-16T07:44:44.596089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"41'784","reported_seq":808,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.206775+0000","last_change":"2024-09-16T07:43:32.434476+0000","last_active":"2024-09-16T07:44:44.206775+0000","last_peered":"2024-09-16T07:44:44.206775+0000","last_clean":"2024-09-16T07:44:44.206775+0000","last_became_active":"2024-09-16T07:43:32.411780+0000","last_became_peered":"2024-09-16T07:43:32.411780+0000","last_unstale":"2024-09-16T07:44:44.206775+0000","last_undegraded":"2024-09-16T07:44:44.206775+0000","last_fullsized":"2024-09-16T07:44:44.206775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":166,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.323147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:44:00.323147+0000","last_peered":"2024-09-16T07:44:00.323147+0000","last_clean":"2024-09-16T07:44:00.323147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:44:00.323147+0000","last_undegraded":"2024-09-16T07:44:00.323147+0000","last_fullsized":"2024-09-16T07:44:00.323147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":98,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.291661+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:44:00.291661+0000","last_peered":"2024-09-16T07:44:00.291661+0000","last_clean":"2024-09-16T07:44:00.291661+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:44:00.291661+0000","last_undegraded":"2024-09-16T07:44:00.291661+0000","last_fullsized":"2024-09-16T07:44:00.291661+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"41'720","reported_seq":744,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:42.185773+0000","last_change":"2024-09-16T07:43:32.424957+0000","last_active":"2024-09-16T07:44:42.185773+0000","last_peered":"2024-09-16T07:44:42.185773+0000","last_clean":"2024-09-16T07:44:42.185773+0000","last_became_active":"2024-09-16T07:43:32.416782+0000","last_became_peered":"2024-09-16T07:43:32.416782+0000","last_unstale":"2024-09-16T07:44:42.185773+0000","last_undegraded":"2024-09-16T07:44:42.185773+0000","last_fullsized":"2024-09-16T07:44:42.185773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.285491+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:44:00.285491+0000","last_peered":"2024-09-16T07:44:00.285491+0000","last_clean":"2024-09-16T07:44:00.285491+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:44:00.285491+0000","last_undegraded":"2024-09-16T07:44:00.285491+0000","last_fullsized":"2024-09-16T07:44:00.285491+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"41'608","reported_seq":632,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:43.697717+0000","last_change":"2024-09-16T07:43:32.400263+0000","last_active":"2024-09-16T07:44:43.697717+0000","last_peered":"2024-09-16T07:44:43.697717+0000","last_clean":"2024-09-16T07:44:43.697717+0000","last_became_active":"2024-09-16T07:43:32.392833+0000","last_became_peered":"2024-09-16T07:43:32.392833+0000","last_unstale":"2024-09-16T07:44:43.697717+0000","last_undegraded":"2024-09-16T07:44:43.697717+0000","last_fullsized":"2024-09-16T07:44:43.697717+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.342119+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:44:00.342119+0000","last_peered":"2024-09-16T07:44:00.342119+0000","last_clean":"2024-09-16T07:44:00.342119+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:44:00.342119+0000","last_undegraded":"2024-09-16T07:44:00.342119+0000","last_fullsized":"2024-09-16T07:44:00.342119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"41'744","reported_seq":768,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.063632+0000","last_change":"2024-09-16T07:43:32.466109+0000","last_active":"2024-09-16T07:44:44.063632+0000","last_peered":"2024-09-16T07:44:44.063632+0000","last_clean":"2024-09-16T07:44:44.063632+0000","last_became_active":"2024-09-16T07:43:32.455735+0000","last_became_peered":"2024-09-16T07:43:32.455735+0000","last_unstale":"2024-09-16T07:44:44.063632+0000","last_undegraded":"2024-09-16T07:44:44.063632+0000","last_fullsized":"2024-09-16T07:44:44.063632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":99,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.291926+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:44:00.291926+0000","last_peered":"2024-09-16T07:44:00.291926+0000","last_clean":"2024-09-16T07:44:00.291926+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:44:00.291926+0000","last_undegraded":"2024-09-16T07:44:00.291926+0000","last_fullsized":"2024-09-16T07:44:00.291926+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"41'784","reported_seq":808,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.741483+0000","last_change":"2024-09-16T07:43:32.461294+0000","last_active":"2024-09-16T07:44:44.741483+0000","last_peered":"2024-09-16T07:44:44.741483+0000","last_clean":"2024-09-16T07:44:44.741483+0000","last_became_active":"2024-09-16T07:43:32.449642+0000","last_became_peered":"2024-09-16T07:43:32.449642+0000","last_unstale":"2024-09-16T07:44:44.741483+0000","last_undegraded":"2024-09-16T07:44:44.741483+0000","last_fullsized":"2024-09-16T07:44:44.741483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.319713+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:44:00.319713+0000","last_peered":"2024-09-16T07:44:00.319713+0000","last_clean":"2024-09-16T07:44:00.319713+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:44:00.319713+0000","last_undegraded":"2024-09-16T07:44:00.319713+0000","last_fullsized":"2024-09-16T07:44:00.319713+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"41'800","reported_seq":824,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.377823+0000","last_change":"2024-09-16T07:43:32.403022+0000","last_active":"2024-09-16T07:44:44.377823+0000","last_peered":"2024-09-16T07:44:44.377823+0000","last_clean":"2024-09-16T07:44:44.377823+0000","last_became_active":"2024-09-16T07:43:32.387358+0000","last_became_peered":"2024-09-16T07:43:32.387358+0000","last_unstale":"2024-09-16T07:44:44.377823+0000","last_undegraded":"2024-09-16T07:44:44.377823+0000","last_fullsized":"2024-09-16T07:44:44.377823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.325645+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:44:00.325645+0000","last_peered":"2024-09-16T07:44:00.325645+0000","last_clean":"2024-09-16T07:44:00.325645+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:44:00.325645+0000","last_undegraded":"2024-09-16T07:44:00.325645+0000","last_fullsized":"2024-09-16T07:44:00.325645+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"41'608","reported_seq":632,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.167200+0000","last_change":"2024-09-16T07:43:32.439788+0000","last_active":"2024-09-16T07:44:44.167200+0000","last_peered":"2024-09-16T07:44:44.167200+0000","last_clean":"2024-09-16T07:44:44.167200+0000","last_became_active":"2024-09-16T07:43:32.430373+0000","last_became_peered":"2024-09-16T07:43:32.430373+0000","last_unstale":"2024-09-16T07:44:44.167200+0000","last_undegraded":"2024-09-16T07:44:44.167200+0000","last_fullsized":"2024-09-16T07:44:44.167200+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.322433+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:44:00.322433+0000","last_peered":"2024-09-16T07:44:00.322433+0000","last_clean":"2024-09-16T07:44:00.322433+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:44:00.322433+0000","last_undegraded":"2024-09-16T07:44:00.322433+0000","last_fullsized":"2024-09-16T07:44:00.322433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"41'584","reported_seq":608,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.662030+0000","last_change":"2024-09-16T07:43:32.470686+0000","last_active":"2024-09-16T07:44:44.662030+0000","last_peered":"2024-09-16T07:44:44.662030+0000","last_clean":"2024-09-16T07:44:44.662030+0000","last_became_active":"2024-09-16T07:43:32.463473+0000","last_became_peered":"2024-09-16T07:43:32.463473+0000","last_unstale":"2024-09-16T07:44:44.662030+0000","last_undegraded":"2024-09-16T07:44:44.662030+0000","last_fullsized":"2024-09-16T07:44:44.662030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.287554+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:44:00.287554+0000","last_peered":"2024-09-16T07:44:00.287554+0000","last_clean":"2024-09-16T07:44:00.287554+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:44:00.287554+0000","last_undegraded":"2024-09-16T07:44:00.287554+0000","last_fullsized":"2024-09-16T07:44:00.287554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":92348416,"num_objects":1410,"num_object_clones":0,"num_object_copies":4230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11273,"num_write_kb":90184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":138522624,"data_stored":277045248,"data_compressed":14302104,"data_compressed_allocated":138522624,"data_compressed_original":277045248,"omap_allocated":0,"internal_metadata":0},"log_size":11273,"ondisk_log_size":11273,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105412,"kb_used_data":34164,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94266428,"statfs":{"total":96636764160,"available":96528822272,"internally_reserved":0,"allocated":34983936,"data_stored":69386033,"data_compressed":3575595,"data_compressed_allocated":34631680,"data_compressed_original":69263360,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96576,"kb_used_data":33648,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94275264,"statfs":{"total":96636764160,"available":96537870336,"internally_reserved":0,"allocated":34455552,"data_stored":68796753,"data_compressed":3544781,"data_compressed_allocated":34082816,"data_compressed_original":68657152,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103484,"kb_used_data":28076,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94268356,"statfs":{"total":96636764160,"available":96530796544,"internally_reserved":0,"allocated":28749824,"data_stored":57385297,"data_compressed":2955648,"data_compressed_allocated":28377088,"data_compressed_original":57245696,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115320,"kb_used_data":39912,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94256520,"statfs":{"total":96636764160,"available":96518676480,"internally_reserved":0,"allocated":40869888,"data_stored":81633598,"data_compressed":4207480,"data_compressed_allocated":40501248,"data_compressed_original":81494016,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40738816,"data_stored":81477632,"data_compressed":4206207,"data_compressed_allocated":40738816,"data_compressed_original":81477632,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28569600,"data_stored":57139200,"data_compressed":2949722,"data_compressed_allocated":28569600,"data_compressed_original":57139200,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34275328,"data_stored":68550656,"data_compressed":3538855,"data_compressed_allocated":34275328,"data_compressed_original":68550656,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34938880,"data_stored":69877760,"data_compressed":3607320,"data_compressed_allocated":34938880,"data_compressed_original":69877760,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:44:54.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:54.248+0000 7f173d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:54.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:54.254+0000 7f173d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:54.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 81 16 12662 12646 1.2196 1.16406 0.155315 0.10242 2024-09-16T07:44:55.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 82 16 12808 12792 1.21864 1.14062 0.108397 0.102498 2024-09-16T07:44:56.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 83 16 12964 12948 1.21864 1.21875 0.0665322 0.10251 2024-09-16T07:44:56.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:44:56.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:56.789+0000 7f8b04f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:56.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:56.795+0000 7f8b04f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:57.375 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 84 16 13112 13096 1.21789 1.15625 0.146854 0.102583 2024-09-16T07:44:58.376 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 85 16 13239 13223 1.21523 0.992188 0.125756 0.102752 2024-09-16T07:44:59.180 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:44:59.180 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:44:59.180 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:44:59.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:44:59.229 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:44:59.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:59.323+0000 7f8eb48bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:59.336+0000 7f8eb48bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.376 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 86 16 13367 13351 1.21273 1 0.187254 0.102963 2024-09-16T07:44:59.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:59.389+0000 7f25bc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:59.397+0000 7f25bc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:59.470 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:59.472 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:59.473 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:59.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:44:59.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:59.603+0000 7f39506d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:59.615+0000 7f39506d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.743 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:44:59.743 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:44:59.743 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:44:59.743 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:44:59.743 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:44:59.743 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:44:59.744 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:44:59.744 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:44:59.744 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:44:59.744 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:44:59.744 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:44:59.744 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:44:59.746 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:44:59.747 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:44:59.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:44:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:59.928+0000 7fbc94ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:44:59.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:44:59.939+0000 7fbc94ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:00.110 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:00.111 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:00.111 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:00.114 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:00.114 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:00.115 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:45:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:00.253+0000 7f08848a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:00.267+0000 7f08848a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:00.361 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:00.362 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:00.376 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 87 16 13529 13513 1.21334 1.26562 0.140965 0.102976 2024-09-16T07:45:01.376 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 88 16 13661 13645 1.21127 1.03125 0.0954721 0.103133 2024-09-16T07:45:01.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:01.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:01.740+0000 7f9971a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:01.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:01.747+0000 7f9971a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:02.376 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 89 16 13814 13798 1.21109 1.19531 0.170296 0.103096 2024-09-16T07:45:03.376 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 90 14 13964 13950 1.21082 1.1875 0.0713438 0.103155 2024-09-16T07:45:04.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:04.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:04.232+0000 7f8c89446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:04.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:04.238+0000 7f8c89446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:04.376 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total time run: 90.0571 2024-09-16T07:45:04.377 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total writes made: 13964 2024-09-16T07:45:04.377 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Write size: 8192 2024-09-16T07:45:04.377 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object size: 65536 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Bandwidth (MB/sec): 1.21138 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Bandwidth: 0.117879 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max bandwidth (MB/sec): 1.5 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min bandwidth (MB/sec): 0.898438 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average IOPS: 155 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev IOPS: 15.0885 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max IOPS: 192 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min IOPS: 115 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average Latency(s): 0.103154 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Latency(s): 0.042224 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max latency(s): 0.327449 2024-09-16T07:45:04.378 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min latency(s): 0.0143729 2024-09-16T07:45:04.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:45:05.363 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:05.363 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:05.363 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:45:05.363 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:45:05.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:05.501+0000 7f1f36711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:05.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:05.515+0000 7f1f36711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:05.701 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:05.701 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:05.701 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:05.701 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:05.702 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:05.705 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:05.706 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:05.706 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:45:05.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:05.860+0000 7f1eaf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:05.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:05.873+0000 7f1eaf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:05.902 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:05.903 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:05.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:05.906 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:05.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:45:06.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:06.038+0000 7f262c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:06.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:06.054+0000 7f262c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:06.121 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:06.126 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:06.127 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:06.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:45:06.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:06.274+0000 7f7ae4151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:06.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:06.288+0000 7f7ae4151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:06.333 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:06.334 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:06.337 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:06.337 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:06.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:06.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:06.491+0000 7f0ffb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:06.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:06.500+0000 7f0ffb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:08.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:09.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:09.110+0000 7f3b27791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:09.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:09.119+0000 7f3b27791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.338 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:11.338 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:11.338 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:11.449 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:11.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:11.514+0000 7f7fcac63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:11.530+0000 7f7fcac63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:11.623+0000 7fa6f78ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:11.635+0000 7fa6f78ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:11.792 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:45:11.792 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:45:11.809 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-16T07:45:11.759048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":92938803,"num_objects":1414,"num_object_clones":0,"num_object_copies":4242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":11354,"num_write_kb":91292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11328,"ondisk_log_size":11328,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":420792,"kb_used_data":135800,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377066568,"statfs":{"total":386547056640,"available":386116165632,"internally_reserved":0,"allocated":139059200,"data_stored":277201681,"data_compressed":14283504,"data_compressed_allocated":137592832,"data_compressed_original":276660224,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002038"},"pg_stats":[{"pgid":"5.f","version":"41'672","reported_seq":696,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:43.412636+0000","last_change":"2024-09-16T07:43:32.425787+0000","last_active":"2024-09-16T07:44:43.412636+0000","last_peered":"2024-09-16T07:44:43.412636+0000","last_clean":"2024-09-16T07:44:43.412636+0000","last_became_active":"2024-09-16T07:43:32.419042+0000","last_became_peered":"2024-09-16T07:43:32.419042+0000","last_unstale":"2024-09-16T07:44:43.412636+0000","last_undegraded":"2024-09-16T07:44:43.412636+0000","last_fullsized":"2024-09-16T07:44:43.412636+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"41'640","reported_seq":664,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:42.560605+0000","last_change":"2024-09-16T07:43:32.475761+0000","last_active":"2024-09-16T07:44:42.560605+0000","last_peered":"2024-09-16T07:44:42.560605+0000","last_clean":"2024-09-16T07:44:42.560605+0000","last_became_active":"2024-09-16T07:43:32.466010+0000","last_became_peered":"2024-09-16T07:43:32.466010+0000","last_unstale":"2024-09-16T07:44:42.560605+0000","last_undegraded":"2024-09-16T07:44:42.560605+0000","last_fullsized":"2024-09-16T07:44:42.560605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"41'792","reported_seq":816,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.734185+0000","last_change":"2024-09-16T07:43:32.446194+0000","last_active":"2024-09-16T07:44:44.734185+0000","last_peered":"2024-09-16T07:44:44.734185+0000","last_clean":"2024-09-16T07:44:44.734185+0000","last_became_active":"2024-09-16T07:43:32.430490+0000","last_became_peered":"2024-09-16T07:43:32.430490+0000","last_unstale":"2024-09-16T07:44:44.734185+0000","last_undegraded":"2024-09-16T07:44:44.734185+0000","last_fullsized":"2024-09-16T07:44:44.734185+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"41'720","reported_seq":744,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.479700+0000","last_change":"2024-09-16T07:43:32.475327+0000","last_active":"2024-09-16T07:44:44.479700+0000","last_peered":"2024-09-16T07:44:44.479700+0000","last_clean":"2024-09-16T07:44:44.479700+0000","last_became_active":"2024-09-16T07:43:32.468309+0000","last_became_peered":"2024-09-16T07:43:32.468309+0000","last_unstale":"2024-09-16T07:44:44.479700+0000","last_undegraded":"2024-09-16T07:44:44.479700+0000","last_fullsized":"2024-09-16T07:44:44.479700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"41'760","reported_seq":784,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.532199+0000","last_change":"2024-09-16T07:43:32.417052+0000","last_active":"2024-09-16T07:44:44.532199+0000","last_peered":"2024-09-16T07:44:44.532199+0000","last_clean":"2024-09-16T07:44:44.532199+0000","last_became_active":"2024-09-16T07:43:32.410819+0000","last_became_peered":"2024-09-16T07:43:32.410819+0000","last_unstale":"2024-09-16T07:44:44.532199+0000","last_undegraded":"2024-09-16T07:44:44.532199+0000","last_fullsized":"2024-09-16T07:44:44.532199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"41'729","reported_seq":753,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:41.647261+0000","last_change":"2024-09-16T07:43:32.441596+0000","last_active":"2024-09-16T07:44:41.647261+0000","last_peered":"2024-09-16T07:44:41.647261+0000","last_clean":"2024-09-16T07:44:41.647261+0000","last_became_active":"2024-09-16T07:43:32.421884+0000","last_became_peered":"2024-09-16T07:43:32.421884+0000","last_unstale":"2024-09-16T07:44:41.647261+0000","last_undegraded":"2024-09-16T07:44:41.647261+0000","last_fullsized":"2024-09-16T07:44:41.647261+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5971968,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":729,"num_write_kb":5832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"41'600","reported_seq":624,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:42.436447+0000","last_change":"2024-09-16T07:43:32.406511+0000","last_active":"2024-09-16T07:44:42.436447+0000","last_peered":"2024-09-16T07:44:42.436447+0000","last_clean":"2024-09-16T07:44:42.436447+0000","last_became_active":"2024-09-16T07:43:32.393311+0000","last_became_peered":"2024-09-16T07:43:32.393311+0000","last_unstale":"2024-09-16T07:44:42.436447+0000","last_undegraded":"2024-09-16T07:44:42.436447+0000","last_fullsized":"2024-09-16T07:44:42.436447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":600,"log_dups_size":0,"ondisk_log_size":600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":600,"num_write_kb":4800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"41'728","reported_seq":752,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.596089+0000","last_change":"2024-09-16T07:43:32.405182+0000","last_active":"2024-09-16T07:44:44.596089+0000","last_peered":"2024-09-16T07:44:44.596089+0000","last_clean":"2024-09-16T07:44:44.596089+0000","last_became_active":"2024-09-16T07:43:32.392235+0000","last_became_peered":"2024-09-16T07:43:32.392235+0000","last_unstale":"2024-09-16T07:44:44.596089+0000","last_undegraded":"2024-09-16T07:44:44.596089+0000","last_fullsized":"2024-09-16T07:44:44.596089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":728,"log_dups_size":0,"ondisk_log_size":728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":728,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"41'784","reported_seq":808,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.206775+0000","last_change":"2024-09-16T07:43:32.434476+0000","last_active":"2024-09-16T07:44:44.206775+0000","last_peered":"2024-09-16T07:44:44.206775+0000","last_clean":"2024-09-16T07:44:44.206775+0000","last_became_active":"2024-09-16T07:43:32.411780+0000","last_became_peered":"2024-09-16T07:43:32.411780+0000","last_unstale":"2024-09-16T07:44:44.206775+0000","last_undegraded":"2024-09-16T07:44:44.206775+0000","last_fullsized":"2024-09-16T07:44:44.206775+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":166,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.323147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:44:00.323147+0000","last_peered":"2024-09-16T07:44:00.323147+0000","last_clean":"2024-09-16T07:44:00.323147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:44:00.323147+0000","last_undegraded":"2024-09-16T07:44:00.323147+0000","last_fullsized":"2024-09-16T07:44:00.323147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":98,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.291661+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:44:00.291661+0000","last_peered":"2024-09-16T07:44:00.291661+0000","last_clean":"2024-09-16T07:44:00.291661+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:44:00.291661+0000","last_undegraded":"2024-09-16T07:44:00.291661+0000","last_fullsized":"2024-09-16T07:44:00.291661+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"41'720","reported_seq":744,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:42.185773+0000","last_change":"2024-09-16T07:43:32.424957+0000","last_active":"2024-09-16T07:44:42.185773+0000","last_peered":"2024-09-16T07:44:42.185773+0000","last_clean":"2024-09-16T07:44:42.185773+0000","last_became_active":"2024-09-16T07:43:32.416782+0000","last_became_peered":"2024-09-16T07:43:32.416782+0000","last_unstale":"2024-09-16T07:44:42.185773+0000","last_undegraded":"2024-09-16T07:44:42.185773+0000","last_fullsized":"2024-09-16T07:44:42.185773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.285491+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:44:00.285491+0000","last_peered":"2024-09-16T07:44:00.285491+0000","last_clean":"2024-09-16T07:44:00.285491+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:44:00.285491+0000","last_undegraded":"2024-09-16T07:44:00.285491+0000","last_fullsized":"2024-09-16T07:44:00.285491+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"41'608","reported_seq":632,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:43.697717+0000","last_change":"2024-09-16T07:43:32.400263+0000","last_active":"2024-09-16T07:44:43.697717+0000","last_peered":"2024-09-16T07:44:43.697717+0000","last_clean":"2024-09-16T07:44:43.697717+0000","last_became_active":"2024-09-16T07:43:32.392833+0000","last_became_peered":"2024-09-16T07:43:32.392833+0000","last_unstale":"2024-09-16T07:44:43.697717+0000","last_undegraded":"2024-09-16T07:44:43.697717+0000","last_fullsized":"2024-09-16T07:44:43.697717+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.342119+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:44:00.342119+0000","last_peered":"2024-09-16T07:44:00.342119+0000","last_clean":"2024-09-16T07:44:00.342119+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:44:00.342119+0000","last_undegraded":"2024-09-16T07:44:00.342119+0000","last_fullsized":"2024-09-16T07:44:00.342119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"41'744","reported_seq":768,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.063632+0000","last_change":"2024-09-16T07:43:32.466109+0000","last_active":"2024-09-16T07:44:44.063632+0000","last_peered":"2024-09-16T07:44:44.063632+0000","last_clean":"2024-09-16T07:44:44.063632+0000","last_became_active":"2024-09-16T07:43:32.455735+0000","last_became_peered":"2024-09-16T07:43:32.455735+0000","last_unstale":"2024-09-16T07:44:44.063632+0000","last_undegraded":"2024-09-16T07:44:44.063632+0000","last_fullsized":"2024-09-16T07:44:44.063632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":99,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.291926+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:44:00.291926+0000","last_peered":"2024-09-16T07:44:00.291926+0000","last_clean":"2024-09-16T07:44:00.291926+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:44:00.291926+0000","last_undegraded":"2024-09-16T07:44:00.291926+0000","last_fullsized":"2024-09-16T07:44:00.291926+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3","version":"41'784","reported_seq":808,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.741483+0000","last_change":"2024-09-16T07:43:32.461294+0000","last_active":"2024-09-16T07:44:44.741483+0000","last_peered":"2024-09-16T07:44:44.741483+0000","last_clean":"2024-09-16T07:44:44.741483+0000","last_became_active":"2024-09-16T07:43:32.449642+0000","last_became_peered":"2024-09-16T07:43:32.449642+0000","last_unstale":"2024-09-16T07:44:44.741483+0000","last_undegraded":"2024-09-16T07:44:44.741483+0000","last_fullsized":"2024-09-16T07:44:44.741483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.319713+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:44:00.319713+0000","last_peered":"2024-09-16T07:44:00.319713+0000","last_clean":"2024-09-16T07:44:00.319713+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:44:00.319713+0000","last_undegraded":"2024-09-16T07:44:00.319713+0000","last_fullsized":"2024-09-16T07:44:00.319713+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"41'800","reported_seq":824,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.377823+0000","last_change":"2024-09-16T07:43:32.403022+0000","last_active":"2024-09-16T07:44:44.377823+0000","last_peered":"2024-09-16T07:44:44.377823+0000","last_clean":"2024-09-16T07:44:44.377823+0000","last_became_active":"2024-09-16T07:43:32.387358+0000","last_became_peered":"2024-09-16T07:43:32.387358+0000","last_unstale":"2024-09-16T07:44:44.377823+0000","last_undegraded":"2024-09-16T07:44:44.377823+0000","last_fullsized":"2024-09-16T07:44:44.377823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.325645+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:44:00.325645+0000","last_peered":"2024-09-16T07:44:00.325645+0000","last_clean":"2024-09-16T07:44:00.325645+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:44:00.325645+0000","last_undegraded":"2024-09-16T07:44:00.325645+0000","last_fullsized":"2024-09-16T07:44:00.325645+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"41'608","reported_seq":632,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.167200+0000","last_change":"2024-09-16T07:43:32.439788+0000","last_active":"2024-09-16T07:44:44.167200+0000","last_peered":"2024-09-16T07:44:44.167200+0000","last_clean":"2024-09-16T07:44:44.167200+0000","last_became_active":"2024-09-16T07:43:32.430373+0000","last_became_peered":"2024-09-16T07:43:32.430373+0000","last_unstale":"2024-09-16T07:44:44.167200+0000","last_undegraded":"2024-09-16T07:44:44.167200+0000","last_fullsized":"2024-09-16T07:44:44.167200+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.322433+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:44:00.322433+0000","last_peered":"2024-09-16T07:44:00.322433+0000","last_clean":"2024-09-16T07:44:00.322433+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:44:00.322433+0000","last_undegraded":"2024-09-16T07:44:00.322433+0000","last_fullsized":"2024-09-16T07:44:00.322433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"41'584","reported_seq":608,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:44.662030+0000","last_change":"2024-09-16T07:43:32.470686+0000","last_active":"2024-09-16T07:44:44.662030+0000","last_peered":"2024-09-16T07:44:44.662030+0000","last_clean":"2024-09-16T07:44:44.662030+0000","last_became_active":"2024-09-16T07:43:32.463473+0000","last_became_peered":"2024-09-16T07:43:32.463473+0000","last_unstale":"2024-09-16T07:44:44.662030+0000","last_undegraded":"2024-09-16T07:44:44.662030+0000","last_fullsized":"2024-09-16T07:44:44.662030+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:43:31.275127+0000","last_clean_scrub_stamp":"2024-09-16T07:43:31.275127+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4784128,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":584,"num_write_kb":4672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.287554+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:44:00.287554+0000","last_peered":"2024-09-16T07:44:00.287554+0000","last_clean":"2024-09-16T07:44:00.287554+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:44:00.287554+0000","last_undegraded":"2024-09-16T07:44:00.287554+0000","last_fullsized":"2024-09-16T07:44:00.287554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":92348416,"num_objects":1410,"num_object_clones":0,"num_object_copies":4230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11273,"num_write_kb":90184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":138522624,"data_stored":277045248,"data_compressed":14302104,"data_compressed_allocated":138522624,"data_compressed_original":277045248,"omap_allocated":0,"internal_metadata":0},"log_size":11273,"ondisk_log_size":11273,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":105412,"kb_used_data":34164,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94266428,"statfs":{"total":96636764160,"available":96528822272,"internally_reserved":0,"allocated":34983936,"data_stored":69386033,"data_compressed":3575595,"data_compressed_allocated":34631680,"data_compressed_original":69263360,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96576,"kb_used_data":33648,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94275264,"statfs":{"total":96636764160,"available":96537870336,"internally_reserved":0,"allocated":34455552,"data_stored":68796753,"data_compressed":3544781,"data_compressed_allocated":34082816,"data_compressed_original":68657152,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103484,"kb_used_data":28076,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94268356,"statfs":{"total":96636764160,"available":96530796544,"internally_reserved":0,"allocated":28749824,"data_stored":57385297,"data_compressed":2955648,"data_compressed_allocated":28377088,"data_compressed_original":57245696,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115320,"kb_used_data":39912,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94256520,"statfs":{"total":96636764160,"available":96518676480,"internally_reserved":0,"allocated":40869888,"data_stored":81633598,"data_compressed":4207480,"data_compressed_allocated":40501248,"data_compressed_original":81494016,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40738816,"data_stored":81477632,"data_compressed":4206207,"data_compressed_allocated":40738816,"data_compressed_original":81477632,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28569600,"data_stored":57139200,"data_compressed":2949722,"data_compressed_allocated":28569600,"data_compressed_original":57139200,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34275328,"data_stored":68550656,"data_compressed":3538855,"data_compressed_allocated":34275328,"data_compressed_original":68550656,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34938880,"data_stored":69877760,"data_compressed":3607320,"data_compressed_allocated":34938880,"data_compressed_original":69877760,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:13.758 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Removed 1746 objects 2024-09-16T07:45:13.758 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Clean up completed and total clean up time :9.35661 2024-09-16T07:45:14.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:14.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:14.316+0000 7f4925591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:14.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:14.321+0000 7f4925591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:16.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:16.540+0000 7f6196d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:16.545+0000 7f6196d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.811 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:16.811 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:16.811 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:45:16.811 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:45:16.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:16.926+0000 7f56a5e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:16.935+0000 7f56a5e74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:16.950 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:16.951 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:16.955 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:16.955 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:16.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:45:17.029 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-09-16T07:45:17.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-09-16T07:45:17.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:17.062+0000 7f35f8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:17.072+0000 7f35f8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.090 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:17.090 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:17.090 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:17.090 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:17.090 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:17.091 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:17.091 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:17.091 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:17.091 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:17.091 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:17.091 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:17.091 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:17.094 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:17.094 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:17.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:45:17.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:17.143+0000 7f73bf046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:17.156+0000 7f73bf046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:17.243+0000 7fc68a2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:17.252+0000 7fc68a2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:17.268 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:17.269 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:17.270 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:17.271 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:17.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:45:17.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:17.416+0000 7f00bb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:17.425+0000 7f00bb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:17.439 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:17.439 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:17.439 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:17.440 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:17.442 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:17.442 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:18.295 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_2' removed 2024-09-16T07:45:18.320 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:45:18.324 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:45:18.325 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-09-16T07:45:18.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-09-16T07:45:18.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:18.470+0000 7f7807f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:18.485+0000 7f7807f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:18.646 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:18.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:18.753+0000 7fd29cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:18.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:18.759+0000 7fd29cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:19.296 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_3' created 2024-09-16T07:45:19.317 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-09-16T07:45:19.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:19.446+0000 7efc25257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:19.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:19.460+0000 7efc25257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:20.299 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-09-16T07:45:20.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:20.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:20.962+0000 7f0d47591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:20.968+0000 7f0d47591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:21.319 DEBUG:teuthology.orchestra.run.smithi137:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-09-16T07:45:21.322 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:45:21.322 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:45:21.385 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:hints = 1 2024-09-16T07:45:21.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:45:21.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object prefix: benchmark_data_smithi137_43766 2024-09-16T07:45:21.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:45:21.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:45:22.385 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 1 16 200 184 1.43742 1.4375 0.0716823 0.0823743 2024-09-16T07:45:22.443 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:22.443 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:22.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:22.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:22.589+0000 7f13fa911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:22.601+0000 7f13fa911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:22.856 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:45:22.856 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:45:22.872 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-16T07:45:21.761528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":290704,"kb_used_data":1552,"kb_used_omap":0,"kb_used_meta":289088,"kb_avail":377196656,"statfs":{"total":386547056640,"available":386249375744,"internally_reserved":0,"allocated":1589248,"data_stored":2261777,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":296026112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-15712,"num_write_kb":-111713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000975"},"pg_stats":[{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":166,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.323147+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:44:00.323147+0000","last_peered":"2024-09-16T07:44:00.323147+0000","last_clean":"2024-09-16T07:44:00.323147+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:44:00.323147+0000","last_undegraded":"2024-09-16T07:44:00.323147+0000","last_fullsized":"2024-09-16T07:44:00.323147+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":98,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.291661+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:44:00.291661+0000","last_peered":"2024-09-16T07:44:00.291661+0000","last_clean":"2024-09-16T07:44:00.291661+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:44:00.291661+0000","last_undegraded":"2024-09-16T07:44:00.291661+0000","last_fullsized":"2024-09-16T07:44:00.291661+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.285491+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:44:00.285491+0000","last_peered":"2024-09-16T07:44:00.285491+0000","last_clean":"2024-09-16T07:44:00.285491+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:44:00.285491+0000","last_undegraded":"2024-09-16T07:44:00.285491+0000","last_fullsized":"2024-09-16T07:44:00.285491+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.342119+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:44:00.342119+0000","last_peered":"2024-09-16T07:44:00.342119+0000","last_clean":"2024-09-16T07:44:00.342119+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:44:00.342119+0000","last_undegraded":"2024-09-16T07:44:00.342119+0000","last_fullsized":"2024-09-16T07:44:00.342119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":99,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.291926+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:44:00.291926+0000","last_peered":"2024-09-16T07:44:00.291926+0000","last_clean":"2024-09-16T07:44:00.291926+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:44:00.291926+0000","last_undegraded":"2024-09-16T07:44:00.291926+0000","last_fullsized":"2024-09-16T07:44:00.291926+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.319713+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:44:00.319713+0000","last_peered":"2024-09-16T07:44:00.319713+0000","last_clean":"2024-09-16T07:44:00.319713+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:44:00.319713+0000","last_undegraded":"2024-09-16T07:44:00.319713+0000","last_fullsized":"2024-09-16T07:44:00.319713+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.325645+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:44:00.325645+0000","last_peered":"2024-09-16T07:44:00.325645+0000","last_clean":"2024-09-16T07:44:00.325645+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:44:00.325645+0000","last_undegraded":"2024-09-16T07:44:00.325645+0000","last_fullsized":"2024-09-16T07:44:00.325645+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.322433+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:44:00.322433+0000","last_peered":"2024-09-16T07:44:00.322433+0000","last_clean":"2024-09-16T07:44:00.322433+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:44:00.322433+0000","last_undegraded":"2024-09-16T07:44:00.322433+0000","last_fullsized":"2024-09-16T07:44:00.322433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:45:19.296546+0000","last_change":"2024-09-16T07:45:19.296546+0000","last_active":"2024-09-16T07:45:19.296546+0000","last_peered":"2024-09-16T07:45:19.296546+0000","last_clean":"2024-09-16T07:45:19.296546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:45:19.296546+0000","last_undegraded":"2024-09-16T07:45:19.296546+0000","last_fullsized":"2024-09-16T07:45:19.296546+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":97,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-16T07:44:00.287554+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:44:00.287554+0000","last_peered":"2024-09-16T07:44:00.287554+0000","last_clean":"2024-09-16T07:44:00.287554+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:44:00.287554+0000","last_undegraded":"2024-09-16T07:44:00.287554+0000","last_fullsized":"2024-09-16T07:44:00.287554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67432,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94304408,"statfs":{"total":96636764160,"available":96567713792,"internally_reserved":0,"allocated":352256,"data_stored":122673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79972,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94291868,"statfs":{"total":96636764160,"available":96554872832,"internally_reserved":0,"allocated":413696,"data_stored":713041,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67492,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94304348,"statfs":{"total":96636764160,"available":96567652352,"internally_reserved":0,"allocated":413696,"data_stored":713041,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":75808,"kb_used_data":400,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94296032,"statfs":{"total":96636764160,"available":96559136768,"internally_reserved":0,"allocated":409600,"data_stored":713022,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:23.067 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:23.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:23.195+0000 7fa526711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:23.202+0000 7fa526711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:23.385 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 2 16 369 353 1.37881 1.32031 0.121513 0.0859154 2024-09-16T07:45:24.385 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 3 16 565 549 1.42959 1.53125 0.0798186 0.0855113 2024-09-16T07:45:25.340 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:25.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 4 16 751 735 1.43544 1.45312 0.118265 0.086322 2024-09-16T07:45:25.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:25.482+0000 7f9237288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:25.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:25.491+0000 7f9237288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:26.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 5 16 943 927 1.44832 1.5 0.0712192 0.0856718 2024-09-16T07:45:27.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 6 15 1140 1125 1.46472 1.54688 0.0472644 0.0847157 2024-09-16T07:45:27.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:27.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:27.862+0000 7f0dcc351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:27.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:27.872+0000 7f0dcc351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:27.874 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:27.874 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:27.875 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:45:27.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:45:28.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:28.030+0000 7f878709c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:28.044+0000 7f878709c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:28.072 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:28.073 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:28.073 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:28.076 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:28.077 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:28.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:45:28.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:28.225+0000 7fdef2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:28.243+0000 7fdef2b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.335 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:28.335 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:28.335 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:28.335 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:28.335 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:28.335 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:28.335 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:28.335 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:28.336 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:28.336 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:28.336 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:28.336 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:28.340 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:28.341 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:28.341 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:45:28.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 7 16 1324 1308 1.4597 1.42969 0.0613291 0.085213 2024-09-16T07:45:28.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:28.504+0000 7fa6d1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:28.521+0000 7fa6d1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.547 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:28.547 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:28.547 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:28.548 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:28.552 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:28.552 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:28.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:45:28.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:28.698+0000 7f73f9e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:28.712+0000 7f73f9e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:28.775 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:28.775 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:28.775 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:28.775 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:28.775 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:28.775 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:28.776 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:28.776 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:28.776 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:28.776 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:28.776 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:28.776 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:28.781 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:28.781 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:29.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 8 16 1521 1505 1.4696 1.53906 0.127684 0.0842172 2024-09-16T07:45:30.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:30.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:30.269+0000 7fb641c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:30.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:30.281+0000 7fb641c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:30.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 9 16 1703 1687 1.46429 1.42188 0.142659 0.0845612 2024-09-16T07:45:31.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 10 16 1883 1867 1.45847 1.40625 0.0353232 0.0854171 2024-09-16T07:45:32.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 11 16 2073 2057 1.46082 1.48438 0.0911497 0.0853054 2024-09-16T07:45:32.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:32.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:32.761+0000 7f08716bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:32.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:32.769+0000 7f08716bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:33.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 12 16 2229 2213 1.44064 1.21875 0.108392 0.0860166 2024-09-16T07:45:33.782 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:33.782 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:33.783 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:45:33.783 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:45:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:33.935+0000 7fbe94991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:33.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:33.945+0000 7fbe94991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:33.961 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:33.961 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:33.961 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:33.961 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:33.961 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:33.961 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:33.962 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:33.962 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:33.962 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:33.962 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:33.962 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:33.962 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:33.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:33.965 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:33.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:45:34.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:34.106+0000 7fabf1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:34.119+0000 7fabf1f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:34.152 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:34.152 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:34.152 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:34.152 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:34.152 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:34.152 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:34.152 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:34.153 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:34.153 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:34.153 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:34.153 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:34.153 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:34.156 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:34.157 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:34.157 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:45:34.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:34.311+0000 7f4097063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:34.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:34.326+0000 7f4097063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:34.349 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:34.350 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:34.351 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:34.354 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:34.354 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:34.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:45:34.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 13 16 2403 2387 1.43438 1.35938 0.0780461 0.0867437 2024-09-16T07:45:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:34.501+0000 7fc471191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:34.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:34.513+0000 7fc471191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:34.569 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:34.569 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:35.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:35.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:35.176+0000 7ffb944fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:35.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:35.183+0000 7ffb944fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:35.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 14 16 2590 2574 1.43626 1.46094 0.0757418 0.0867841 2024-09-16T07:45:36.386 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 15 16 2769 2753 1.43374 1.39844 0.0692312 0.0870098 2024-09-16T07:45:37.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 16 16 2956 2940 1.43543 1.46094 0.0526164 0.0868406 2024-09-16T07:45:37.449 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:37.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:37.572+0000 7f6af0697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:37.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:37.580+0000 7f6af0697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:38.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 17 16 3133 3117 1.43233 1.38281 0.111127 0.0869829 2024-09-16T07:45:39.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 18 16 3338 3322 1.44172 1.60156 0.0800517 0.0865181 2024-09-16T07:45:39.570 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:39.571 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:39.571 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:45:39.571 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:45:39.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:39.696+0000 7fcda96bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:39.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:39.708+0000 7fcda96bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:39.734 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:39.734 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:39.734 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:39.734 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:39.734 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:39.734 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:39.734 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:39.735 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:39.735 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:39.735 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:39.735 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:39.735 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:39.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:39.738 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:39.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:45:39.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:39.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:39.862+0000 7f9b51d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:39.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:39.877+0000 7f9b51d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:39.982 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:39.983 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:39.983 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:39.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:39.981+0000 7fed4f846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:39.987 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:39.987 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:39.988 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:45:39.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:39.991+0000 7fed4f846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:40.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:40.144+0000 7f361e351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:40.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:40.159+0000 7f361e351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:40.186 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:40.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:40.190 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:40.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:45:40.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:40.368+0000 7f76718d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:40.380+0000 7f76718d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:40.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 19 16 3494 3478 1.42997 1.21875 0.038551 0.0872336 2024-09-16T07:45:40.413 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:45:40.413 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:45:40.413 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:45:40.413 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:45:40.413 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:45:40.413 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:45:40.413 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:45:40.413 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:45:40.414 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:45:40.414 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:45:40.414 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:45:40.414 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:45:40.416 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:45:40.417 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:45:41.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:45:41.388833+0000 min lat: 0.0206628 max lat: 0.271629 avg lat: 0.0872402 2024-09-16T07:45:41.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:45:41.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 20 16 3678 3662 1.43034 1.4375 0.0389567 0.0872402 2024-09-16T07:45:42.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:42.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:42.334+0000 7f6baec88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:42.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:42.341+0000 7f6baec88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:42.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 21 16 3854 3838 1.4277 1.375 0.108484 0.0872416 2024-09-16T07:45:43.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 22 16 4043 4027 1.42992 1.47656 0.0501253 0.0873122 2024-09-16T07:45:44.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 23 16 4234 4218 1.43262 1.49219 0.0945841 0.0870861 2024-09-16T07:45:44.663 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:44.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:44.812+0000 7f19b78ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:44.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:44.819+0000 7f19b78ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:45.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 24 15 4388 4373 1.42338 1.21094 0.128097 0.0875354 2024-09-16T07:45:45.418 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:45.418 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:45.418 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:45.573+0000 7fe23ad51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:45.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:45.585+0000 7fe23ad51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:45.896 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:45:45.897 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:45:45.914 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-09-16T07:45:45.765948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35668531,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4363,"num_write_kb":35364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4337,"ondisk_log_size":4337,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":333004,"kb_used_data":52172,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377154356,"statfs":{"total":386547056640,"available":386206060544,"internally_reserved":0,"allocated":53424128,"data_stored":105693053,"data_compressed":5424618,"data_compressed_allocated":51810304,"data_compressed_original":105095168,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35078144,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4282,"num_write_kb":34256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002171"},"pg_stats":[{"pgid":"6.f","version":"45'266","reported_seq":278,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.736641+0000","last_change":"2024-09-16T07:45:20.518363+0000","last_active":"2024-09-16T07:45:44.736641+0000","last_peered":"2024-09-16T07:45:44.736641+0000","last_clean":"2024-09-16T07:45:44.736641+0000","last_became_active":"2024-09-16T07:45:20.511671+0000","last_became_peered":"2024-09-16T07:45:20.511671+0000","last_unstale":"2024-09-16T07:45:44.736641+0000","last_undegraded":"2024-09-16T07:45:44.736641+0000","last_fullsized":"2024-09-16T07:45:44.736641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179072,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":2128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"45'328","reported_seq":340,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.740949+0000","last_change":"2024-09-16T07:45:20.429293+0000","last_active":"2024-09-16T07:45:44.740949+0000","last_peered":"2024-09-16T07:45:44.740949+0000","last_clean":"2024-09-16T07:45:44.740949+0000","last_became_active":"2024-09-16T07:45:20.417784+0000","last_became_peered":"2024-09-16T07:45:20.417784+0000","last_unstale":"2024-09-16T07:45:44.740949+0000","last_undegraded":"2024-09-16T07:45:44.740949+0000","last_fullsized":"2024-09-16T07:45:44.740949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.049968+0000","last_change":"2024-09-16T07:45:20.434860+0000","last_active":"2024-09-16T07:45:44.049968+0000","last_peered":"2024-09-16T07:45:44.049968+0000","last_clean":"2024-09-16T07:45:44.049968+0000","last_became_active":"2024-09-16T07:45:20.424106+0000","last_became_peered":"2024-09-16T07:45:20.424106+0000","last_unstale":"2024-09-16T07:45:44.049968+0000","last_undegraded":"2024-09-16T07:45:44.049968+0000","last_fullsized":"2024-09-16T07:45:44.049968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"45'272","reported_seq":284,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.274008+0000","last_change":"2024-09-16T07:45:20.515551+0000","last_active":"2024-09-16T07:45:44.274008+0000","last_peered":"2024-09-16T07:45:44.274008+0000","last_clean":"2024-09-16T07:45:44.274008+0000","last_became_active":"2024-09-16T07:45:20.507157+0000","last_became_peered":"2024-09-16T07:45:20.507157+0000","last_unstale":"2024-09-16T07:45:44.274008+0000","last_undegraded":"2024-09-16T07:45:44.274008+0000","last_fullsized":"2024-09-16T07:45:44.274008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"45'144","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.425370+0000","last_change":"2024-09-16T07:45:20.483112+0000","last_active":"2024-09-16T07:45:43.425370+0000","last_peered":"2024-09-16T07:45:43.425370+0000","last_clean":"2024-09-16T07:45:43.425370+0000","last_became_active":"2024-09-16T07:45:20.469905+0000","last_became_peered":"2024-09-16T07:45:20.469905+0000","last_unstale":"2024-09-16T07:45:43.425370+0000","last_undegraded":"2024-09-16T07:45:43.425370+0000","last_fullsized":"2024-09-16T07:45:43.425370+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.297811+0000","last_change":"2024-09-16T07:45:20.419879+0000","last_active":"2024-09-16T07:45:44.297811+0000","last_peered":"2024-09-16T07:45:44.297811+0000","last_clean":"2024-09-16T07:45:44.297811+0000","last_became_active":"2024-09-16T07:45:20.414183+0000","last_became_peered":"2024-09-16T07:45:20.414183+0000","last_unstale":"2024-09-16T07:45:44.297811+0000","last_undegraded":"2024-09-16T07:45:44.297811+0000","last_fullsized":"2024-09-16T07:45:44.297811+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"45'288","reported_seq":300,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.530368+0000","last_change":"2024-09-16T07:45:20.421367+0000","last_active":"2024-09-16T07:45:44.530368+0000","last_peered":"2024-09-16T07:45:44.530368+0000","last_clean":"2024-09-16T07:45:44.530368+0000","last_became_active":"2024-09-16T07:45:20.411622+0000","last_became_peered":"2024-09-16T07:45:20.411622+0000","last_unstale":"2024-09-16T07:45:44.530368+0000","last_undegraded":"2024-09-16T07:45:44.530368+0000","last_fullsized":"2024-09-16T07:45:44.530368+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"45'352","reported_seq":364,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.114771+0000","last_change":"2024-09-16T07:45:20.441791+0000","last_active":"2024-09-16T07:45:43.114771+0000","last_peered":"2024-09-16T07:45:43.114771+0000","last_clean":"2024-09-16T07:45:43.114771+0000","last_became_active":"2024-09-16T07:45:20.430403+0000","last_became_peered":"2024-09-16T07:45:20.430403+0000","last_unstale":"2024-09-16T07:45:43.114771+0000","last_undegraded":"2024-09-16T07:45:43.114771+0000","last_fullsized":"2024-09-16T07:45:43.114771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.411814+0000","last_change":"2024-09-16T07:45:20.448632+0000","last_active":"2024-09-16T07:45:44.411814+0000","last_peered":"2024-09-16T07:45:44.411814+0000","last_clean":"2024-09-16T07:45:44.411814+0000","last_became_active":"2024-09-16T07:45:20.436131+0000","last_became_peered":"2024-09-16T07:45:20.436131+0000","last_unstale":"2024-09-16T07:45:44.411814+0000","last_undegraded":"2024-09-16T07:45:44.411814+0000","last_fullsized":"2024-09-16T07:45:44.411814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.372708+0000","last_change":"2024-09-16T07:45:20.501623+0000","last_active":"2024-09-16T07:45:44.372708+0000","last_peered":"2024-09-16T07:45:44.372708+0000","last_clean":"2024-09-16T07:45:44.372708+0000","last_became_active":"2024-09-16T07:45:20.494483+0000","last_became_peered":"2024-09-16T07:45:20.494483+0000","last_unstale":"2024-09-16T07:45:44.372708+0000","last_undegraded":"2024-09-16T07:45:44.372708+0000","last_fullsized":"2024-09-16T07:45:44.372708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"45'168","reported_seq":180,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.698224+0000","last_change":"2024-09-16T07:45:20.478109+0000","last_active":"2024-09-16T07:45:44.698224+0000","last_peered":"2024-09-16T07:45:44.698224+0000","last_clean":"2024-09-16T07:45:44.698224+0000","last_became_active":"2024-09-16T07:45:20.471340+0000","last_became_peered":"2024-09-16T07:45:20.471340+0000","last_unstale":"2024-09-16T07:45:44.698224+0000","last_undegraded":"2024-09-16T07:45:44.698224+0000","last_fullsized":"2024-09-16T07:45:44.698224+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.651406+0000","last_change":"2024-09-16T07:45:20.425615+0000","last_active":"2024-09-16T07:45:44.651406+0000","last_peered":"2024-09-16T07:45:44.651406+0000","last_clean":"2024-09-16T07:45:44.651406+0000","last_became_active":"2024-09-16T07:45:20.415753+0000","last_became_peered":"2024-09-16T07:45:20.415753+0000","last_unstale":"2024-09-16T07:45:44.651406+0000","last_undegraded":"2024-09-16T07:45:44.651406+0000","last_fullsized":"2024-09-16T07:45:44.651406+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"45'264","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.377809+0000","last_change":"2024-09-16T07:45:20.428249+0000","last_active":"2024-09-16T07:45:43.377809+0000","last_peered":"2024-09-16T07:45:43.377809+0000","last_clean":"2024-09-16T07:45:43.377809+0000","last_became_active":"2024-09-16T07:45:20.420592+0000","last_became_peered":"2024-09-16T07:45:20.420592+0000","last_unstale":"2024-09-16T07:45:43.377809+0000","last_undegraded":"2024-09-16T07:45:43.377809+0000","last_fullsized":"2024-09-16T07:45:43.377809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.460187+0000","last_change":"2024-09-16T07:45:20.452728+0000","last_active":"2024-09-16T07:45:44.460187+0000","last_peered":"2024-09-16T07:45:44.460187+0000","last_clean":"2024-09-16T07:45:44.460187+0000","last_became_active":"2024-09-16T07:45:20.442417+0000","last_became_peered":"2024-09-16T07:45:20.442417+0000","last_unstale":"2024-09-16T07:45:44.460187+0000","last_undegraded":"2024-09-16T07:45:44.460187+0000","last_fullsized":"2024-09-16T07:45:44.460187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"45'264","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.345137+0000","last_change":"2024-09-16T07:45:20.454595+0000","last_active":"2024-09-16T07:45:44.345137+0000","last_peered":"2024-09-16T07:45:44.345137+0000","last_clean":"2024-09-16T07:45:44.345137+0000","last_became_active":"2024-09-16T07:45:20.442809+0000","last_became_peered":"2024-09-16T07:45:20.442809+0000","last_unstale":"2024-09-16T07:45:44.345137+0000","last_undegraded":"2024-09-16T07:45:44.345137+0000","last_fullsized":"2024-09-16T07:45:44.345137+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"45'208","reported_seq":220,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.234950+0000","last_change":"2024-09-16T07:45:20.460812+0000","last_active":"2024-09-16T07:45:43.234950+0000","last_peered":"2024-09-16T07:45:43.234950+0000","last_clean":"2024-09-16T07:45:43.234950+0000","last_became_active":"2024-09-16T07:45:20.448491+0000","last_became_peered":"2024-09-16T07:45:20.448491+0000","last_unstale":"2024-09-16T07:45:43.234950+0000","last_undegraded":"2024-09-16T07:45:43.234950+0000","last_fullsized":"2024-09-16T07:45:43.234950+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":35078144,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4282,"num_write_kb":34256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52596736,"data_stored":105193472,"data_compressed":5428413,"data_compressed_allocated":52596736,"data_compressed_original":105193472,"omap_allocated":0,"internal_metadata":0},"log_size":4282,"ondisk_log_size":4282,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79772,"kb_used_data":12684,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94292068,"statfs":{"total":96636764160,"available":96555077632,"internally_reserved":0,"allocated":12988416,"data_stored":25335372,"data_compressed":1300344,"data_compressed_allocated":12599296,"data_compressed_original":25198592,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89908,"kb_used_data":14500,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94281932,"statfs":{"total":96636764160,"available":96544698368,"internally_reserved":0,"allocated":14848000,"data_stored":29522028,"data_compressed":1515916,"data_compressed_allocated":14438400,"data_compressed_original":29368320,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79896,"kb_used_data":12808,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94291944,"statfs":{"total":96636764160,"available":96554950656,"internally_reserved":0,"allocated":13115392,"data_stored":26056812,"data_compressed":1337147,"data_compressed_allocated":12705792,"data_compressed_original":25903104,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83428,"kb_used_data":12180,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94288412,"statfs":{"total":96636764160,"available":96551333888,"internally_reserved":0,"allocated":12472320,"data_stored":24778841,"data_compressed":1271211,"data_compressed_allocated":12066816,"data_compressed_original":24625152,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288000,"data_stored":24576000,"data_compressed":1268246,"data_compressed_allocated":12288000,"data_compressed_original":24576000,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12926976,"data_stored":25853952,"data_compressed":1334182,"data_compressed_allocated":12926976,"data_compressed_original":25853952,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14524416,"data_stored":29048832,"data_compressed":1498992,"data_compressed_allocated":14524416,"data_compressed_original":29048832,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":25714688,"data_compressed":1326993,"data_compressed_allocated":12857344,"data_compressed_original":25714688,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:46.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 25 16 4581 4565 1.42644 1.5 0.0894393 0.0874352 2024-09-16T07:45:47.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:47.293+0000 7f70ee951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:47.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:47.301+0000 7f70ee951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:47.387 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 26 16 4761 4745 1.42566 1.40625 0.0441885 0.0875092 2024-09-16T07:45:48.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 27 16 4941 4925 1.42493 1.40625 0.0649257 0.0876319 2024-09-16T07:45:49.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 28 16 5103 5087 1.41924 1.26562 0.113032 0.0878289 2024-09-16T07:45:49.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:49.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:49.731+0000 7f677ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:49.739+0000 7f677ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:50.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 29 16 5283 5267 1.41879 1.40625 0.0478437 0.0879543 2024-09-16T07:45:50.917 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:50.917 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:50.918 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:51.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:51.063+0000 7f44da351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:51.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:51.073+0000 7f44da351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:51.290 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:45:51.291 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:45:51.312 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-09-16T07:45:49.766790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35668531,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4363,"num_write_kb":35364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4337,"ondisk_log_size":4337,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":333004,"kb_used_data":52172,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377154356,"statfs":{"total":386547056640,"available":386206060544,"internally_reserved":0,"allocated":53424128,"data_stored":105693053,"data_compressed":5424618,"data_compressed_allocated":51810304,"data_compressed_original":105095168,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35078144,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4282,"num_write_kb":34256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002272"},"pg_stats":[{"pgid":"6.f","version":"45'266","reported_seq":278,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.736641+0000","last_change":"2024-09-16T07:45:20.518363+0000","last_active":"2024-09-16T07:45:44.736641+0000","last_peered":"2024-09-16T07:45:44.736641+0000","last_clean":"2024-09-16T07:45:44.736641+0000","last_became_active":"2024-09-16T07:45:20.511671+0000","last_became_peered":"2024-09-16T07:45:20.511671+0000","last_unstale":"2024-09-16T07:45:44.736641+0000","last_undegraded":"2024-09-16T07:45:44.736641+0000","last_fullsized":"2024-09-16T07:45:44.736641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179072,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":2128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"45'328","reported_seq":340,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.740949+0000","last_change":"2024-09-16T07:45:20.429293+0000","last_active":"2024-09-16T07:45:44.740949+0000","last_peered":"2024-09-16T07:45:44.740949+0000","last_clean":"2024-09-16T07:45:44.740949+0000","last_became_active":"2024-09-16T07:45:20.417784+0000","last_became_peered":"2024-09-16T07:45:20.417784+0000","last_unstale":"2024-09-16T07:45:44.740949+0000","last_undegraded":"2024-09-16T07:45:44.740949+0000","last_fullsized":"2024-09-16T07:45:44.740949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.049968+0000","last_change":"2024-09-16T07:45:20.434860+0000","last_active":"2024-09-16T07:45:44.049968+0000","last_peered":"2024-09-16T07:45:44.049968+0000","last_clean":"2024-09-16T07:45:44.049968+0000","last_became_active":"2024-09-16T07:45:20.424106+0000","last_became_peered":"2024-09-16T07:45:20.424106+0000","last_unstale":"2024-09-16T07:45:44.049968+0000","last_undegraded":"2024-09-16T07:45:44.049968+0000","last_fullsized":"2024-09-16T07:45:44.049968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"45'272","reported_seq":284,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.274008+0000","last_change":"2024-09-16T07:45:20.515551+0000","last_active":"2024-09-16T07:45:44.274008+0000","last_peered":"2024-09-16T07:45:44.274008+0000","last_clean":"2024-09-16T07:45:44.274008+0000","last_became_active":"2024-09-16T07:45:20.507157+0000","last_became_peered":"2024-09-16T07:45:20.507157+0000","last_unstale":"2024-09-16T07:45:44.274008+0000","last_undegraded":"2024-09-16T07:45:44.274008+0000","last_fullsized":"2024-09-16T07:45:44.274008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"45'144","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.425370+0000","last_change":"2024-09-16T07:45:20.483112+0000","last_active":"2024-09-16T07:45:43.425370+0000","last_peered":"2024-09-16T07:45:43.425370+0000","last_clean":"2024-09-16T07:45:43.425370+0000","last_became_active":"2024-09-16T07:45:20.469905+0000","last_became_peered":"2024-09-16T07:45:20.469905+0000","last_unstale":"2024-09-16T07:45:43.425370+0000","last_undegraded":"2024-09-16T07:45:43.425370+0000","last_fullsized":"2024-09-16T07:45:43.425370+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.297811+0000","last_change":"2024-09-16T07:45:20.419879+0000","last_active":"2024-09-16T07:45:44.297811+0000","last_peered":"2024-09-16T07:45:44.297811+0000","last_clean":"2024-09-16T07:45:44.297811+0000","last_became_active":"2024-09-16T07:45:20.414183+0000","last_became_peered":"2024-09-16T07:45:20.414183+0000","last_unstale":"2024-09-16T07:45:44.297811+0000","last_undegraded":"2024-09-16T07:45:44.297811+0000","last_fullsized":"2024-09-16T07:45:44.297811+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"45'288","reported_seq":300,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.530368+0000","last_change":"2024-09-16T07:45:20.421367+0000","last_active":"2024-09-16T07:45:44.530368+0000","last_peered":"2024-09-16T07:45:44.530368+0000","last_clean":"2024-09-16T07:45:44.530368+0000","last_became_active":"2024-09-16T07:45:20.411622+0000","last_became_peered":"2024-09-16T07:45:20.411622+0000","last_unstale":"2024-09-16T07:45:44.530368+0000","last_undegraded":"2024-09-16T07:45:44.530368+0000","last_fullsized":"2024-09-16T07:45:44.530368+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"45'352","reported_seq":364,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.114771+0000","last_change":"2024-09-16T07:45:20.441791+0000","last_active":"2024-09-16T07:45:43.114771+0000","last_peered":"2024-09-16T07:45:43.114771+0000","last_clean":"2024-09-16T07:45:43.114771+0000","last_became_active":"2024-09-16T07:45:20.430403+0000","last_became_peered":"2024-09-16T07:45:20.430403+0000","last_unstale":"2024-09-16T07:45:43.114771+0000","last_undegraded":"2024-09-16T07:45:43.114771+0000","last_fullsized":"2024-09-16T07:45:43.114771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.411814+0000","last_change":"2024-09-16T07:45:20.448632+0000","last_active":"2024-09-16T07:45:44.411814+0000","last_peered":"2024-09-16T07:45:44.411814+0000","last_clean":"2024-09-16T07:45:44.411814+0000","last_became_active":"2024-09-16T07:45:20.436131+0000","last_became_peered":"2024-09-16T07:45:20.436131+0000","last_unstale":"2024-09-16T07:45:44.411814+0000","last_undegraded":"2024-09-16T07:45:44.411814+0000","last_fullsized":"2024-09-16T07:45:44.411814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.372708+0000","last_change":"2024-09-16T07:45:20.501623+0000","last_active":"2024-09-16T07:45:44.372708+0000","last_peered":"2024-09-16T07:45:44.372708+0000","last_clean":"2024-09-16T07:45:44.372708+0000","last_became_active":"2024-09-16T07:45:20.494483+0000","last_became_peered":"2024-09-16T07:45:20.494483+0000","last_unstale":"2024-09-16T07:45:44.372708+0000","last_undegraded":"2024-09-16T07:45:44.372708+0000","last_fullsized":"2024-09-16T07:45:44.372708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"45'168","reported_seq":180,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.698224+0000","last_change":"2024-09-16T07:45:20.478109+0000","last_active":"2024-09-16T07:45:44.698224+0000","last_peered":"2024-09-16T07:45:44.698224+0000","last_clean":"2024-09-16T07:45:44.698224+0000","last_became_active":"2024-09-16T07:45:20.471340+0000","last_became_peered":"2024-09-16T07:45:20.471340+0000","last_unstale":"2024-09-16T07:45:44.698224+0000","last_undegraded":"2024-09-16T07:45:44.698224+0000","last_fullsized":"2024-09-16T07:45:44.698224+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.651406+0000","last_change":"2024-09-16T07:45:20.425615+0000","last_active":"2024-09-16T07:45:44.651406+0000","last_peered":"2024-09-16T07:45:44.651406+0000","last_clean":"2024-09-16T07:45:44.651406+0000","last_became_active":"2024-09-16T07:45:20.415753+0000","last_became_peered":"2024-09-16T07:45:20.415753+0000","last_unstale":"2024-09-16T07:45:44.651406+0000","last_undegraded":"2024-09-16T07:45:44.651406+0000","last_fullsized":"2024-09-16T07:45:44.651406+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"45'264","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.377809+0000","last_change":"2024-09-16T07:45:20.428249+0000","last_active":"2024-09-16T07:45:43.377809+0000","last_peered":"2024-09-16T07:45:43.377809+0000","last_clean":"2024-09-16T07:45:43.377809+0000","last_became_active":"2024-09-16T07:45:20.420592+0000","last_became_peered":"2024-09-16T07:45:20.420592+0000","last_unstale":"2024-09-16T07:45:43.377809+0000","last_undegraded":"2024-09-16T07:45:43.377809+0000","last_fullsized":"2024-09-16T07:45:43.377809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.460187+0000","last_change":"2024-09-16T07:45:20.452728+0000","last_active":"2024-09-16T07:45:44.460187+0000","last_peered":"2024-09-16T07:45:44.460187+0000","last_clean":"2024-09-16T07:45:44.460187+0000","last_became_active":"2024-09-16T07:45:20.442417+0000","last_became_peered":"2024-09-16T07:45:20.442417+0000","last_unstale":"2024-09-16T07:45:44.460187+0000","last_undegraded":"2024-09-16T07:45:44.460187+0000","last_fullsized":"2024-09-16T07:45:44.460187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"45'264","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.345137+0000","last_change":"2024-09-16T07:45:20.454595+0000","last_active":"2024-09-16T07:45:44.345137+0000","last_peered":"2024-09-16T07:45:44.345137+0000","last_clean":"2024-09-16T07:45:44.345137+0000","last_became_active":"2024-09-16T07:45:20.442809+0000","last_became_peered":"2024-09-16T07:45:20.442809+0000","last_unstale":"2024-09-16T07:45:44.345137+0000","last_undegraded":"2024-09-16T07:45:44.345137+0000","last_fullsized":"2024-09-16T07:45:44.345137+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"45'208","reported_seq":220,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.234950+0000","last_change":"2024-09-16T07:45:20.460812+0000","last_active":"2024-09-16T07:45:43.234950+0000","last_peered":"2024-09-16T07:45:43.234950+0000","last_clean":"2024-09-16T07:45:43.234950+0000","last_became_active":"2024-09-16T07:45:20.448491+0000","last_became_peered":"2024-09-16T07:45:20.448491+0000","last_unstale":"2024-09-16T07:45:43.234950+0000","last_undegraded":"2024-09-16T07:45:43.234950+0000","last_fullsized":"2024-09-16T07:45:43.234950+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":35078144,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4282,"num_write_kb":34256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52596736,"data_stored":105193472,"data_compressed":5428413,"data_compressed_allocated":52596736,"data_compressed_original":105193472,"omap_allocated":0,"internal_metadata":0},"log_size":4282,"ondisk_log_size":4282,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79772,"kb_used_data":12684,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94292068,"statfs":{"total":96636764160,"available":96555077632,"internally_reserved":0,"allocated":12988416,"data_stored":25335372,"data_compressed":1300344,"data_compressed_allocated":12599296,"data_compressed_original":25198592,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89908,"kb_used_data":14500,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94281932,"statfs":{"total":96636764160,"available":96544698368,"internally_reserved":0,"allocated":14848000,"data_stored":29522028,"data_compressed":1515916,"data_compressed_allocated":14438400,"data_compressed_original":29368320,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79896,"kb_used_data":12808,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94291944,"statfs":{"total":96636764160,"available":96554950656,"internally_reserved":0,"allocated":13115392,"data_stored":26056812,"data_compressed":1337147,"data_compressed_allocated":12705792,"data_compressed_original":25903104,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83428,"kb_used_data":12180,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94288412,"statfs":{"total":96636764160,"available":96551333888,"internally_reserved":0,"allocated":12472320,"data_stored":24778841,"data_compressed":1271211,"data_compressed_allocated":12066816,"data_compressed_original":24625152,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288000,"data_stored":24576000,"data_compressed":1268246,"data_compressed_allocated":12288000,"data_compressed_original":24576000,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12926976,"data_stored":25853952,"data_compressed":1334182,"data_compressed_allocated":12926976,"data_compressed_original":25853952,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14524416,"data_stored":29048832,"data_compressed":1498992,"data_compressed_allocated":14524416,"data_compressed_original":29048832,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":25714688,"data_compressed":1326993,"data_compressed_allocated":12857344,"data_compressed_original":25714688,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:51.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 30 16 5441 5425 1.41264 1.23438 0.067282 0.088279 2024-09-16T07:45:52.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:52.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:52.319+0000 7fd6d5e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:52.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:52.328+0000 7fd6d5e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:52.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 31 16 5620 5604 1.41218 1.39844 0.0221633 0.0883196 2024-09-16T07:45:53.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 32 16 5797 5781 1.41125 1.38281 0.0695432 0.0883894 2024-09-16T07:45:54.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 33 16 5987 5971 1.41346 1.48438 0.0718169 0.0883305 2024-09-16T07:45:54.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:54.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:54.865+0000 7f66b3b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:54.873+0000 7f66b3b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:55.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 34 16 6173 6157 1.41463 1.45312 0.0481936 0.0882752 2024-09-16T07:45:56.314 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:45:56.315 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:45:56.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:45:56.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 35 16 6361 6345 1.41617 1.46875 0.0433679 0.088173 2024-09-16T07:45:56.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:56.471+0000 7fcb5bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:56.485+0000 7fcb5bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:56.756 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:45:56.757 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:45:56.770 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-09-16T07:45:55.767976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35668531,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4363,"num_write_kb":35364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4337,"ondisk_log_size":4337,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":333004,"kb_used_data":52172,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377154356,"statfs":{"total":386547056640,"available":386206060544,"internally_reserved":0,"allocated":53424128,"data_stored":105693053,"data_compressed":5424618,"data_compressed_allocated":51810304,"data_compressed_original":105095168,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35078144,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4282,"num_write_kb":34256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002323"},"pg_stats":[{"pgid":"6.f","version":"45'266","reported_seq":278,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.736641+0000","last_change":"2024-09-16T07:45:20.518363+0000","last_active":"2024-09-16T07:45:44.736641+0000","last_peered":"2024-09-16T07:45:44.736641+0000","last_clean":"2024-09-16T07:45:44.736641+0000","last_became_active":"2024-09-16T07:45:20.511671+0000","last_became_peered":"2024-09-16T07:45:20.511671+0000","last_unstale":"2024-09-16T07:45:44.736641+0000","last_undegraded":"2024-09-16T07:45:44.736641+0000","last_fullsized":"2024-09-16T07:45:44.736641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179072,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":2128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"45'328","reported_seq":340,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.740949+0000","last_change":"2024-09-16T07:45:20.429293+0000","last_active":"2024-09-16T07:45:44.740949+0000","last_peered":"2024-09-16T07:45:44.740949+0000","last_clean":"2024-09-16T07:45:44.740949+0000","last_became_active":"2024-09-16T07:45:20.417784+0000","last_became_peered":"2024-09-16T07:45:20.417784+0000","last_unstale":"2024-09-16T07:45:44.740949+0000","last_undegraded":"2024-09-16T07:45:44.740949+0000","last_fullsized":"2024-09-16T07:45:44.740949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.049968+0000","last_change":"2024-09-16T07:45:20.434860+0000","last_active":"2024-09-16T07:45:44.049968+0000","last_peered":"2024-09-16T07:45:44.049968+0000","last_clean":"2024-09-16T07:45:44.049968+0000","last_became_active":"2024-09-16T07:45:20.424106+0000","last_became_peered":"2024-09-16T07:45:20.424106+0000","last_unstale":"2024-09-16T07:45:44.049968+0000","last_undegraded":"2024-09-16T07:45:44.049968+0000","last_fullsized":"2024-09-16T07:45:44.049968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"45'272","reported_seq":284,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.274008+0000","last_change":"2024-09-16T07:45:20.515551+0000","last_active":"2024-09-16T07:45:44.274008+0000","last_peered":"2024-09-16T07:45:44.274008+0000","last_clean":"2024-09-16T07:45:44.274008+0000","last_became_active":"2024-09-16T07:45:20.507157+0000","last_became_peered":"2024-09-16T07:45:20.507157+0000","last_unstale":"2024-09-16T07:45:44.274008+0000","last_undegraded":"2024-09-16T07:45:44.274008+0000","last_fullsized":"2024-09-16T07:45:44.274008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"45'144","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.425370+0000","last_change":"2024-09-16T07:45:20.483112+0000","last_active":"2024-09-16T07:45:43.425370+0000","last_peered":"2024-09-16T07:45:43.425370+0000","last_clean":"2024-09-16T07:45:43.425370+0000","last_became_active":"2024-09-16T07:45:20.469905+0000","last_became_peered":"2024-09-16T07:45:20.469905+0000","last_unstale":"2024-09-16T07:45:43.425370+0000","last_undegraded":"2024-09-16T07:45:43.425370+0000","last_fullsized":"2024-09-16T07:45:43.425370+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.297811+0000","last_change":"2024-09-16T07:45:20.419879+0000","last_active":"2024-09-16T07:45:44.297811+0000","last_peered":"2024-09-16T07:45:44.297811+0000","last_clean":"2024-09-16T07:45:44.297811+0000","last_became_active":"2024-09-16T07:45:20.414183+0000","last_became_peered":"2024-09-16T07:45:20.414183+0000","last_unstale":"2024-09-16T07:45:44.297811+0000","last_undegraded":"2024-09-16T07:45:44.297811+0000","last_fullsized":"2024-09-16T07:45:44.297811+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"45'288","reported_seq":300,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.530368+0000","last_change":"2024-09-16T07:45:20.421367+0000","last_active":"2024-09-16T07:45:44.530368+0000","last_peered":"2024-09-16T07:45:44.530368+0000","last_clean":"2024-09-16T07:45:44.530368+0000","last_became_active":"2024-09-16T07:45:20.411622+0000","last_became_peered":"2024-09-16T07:45:20.411622+0000","last_unstale":"2024-09-16T07:45:44.530368+0000","last_undegraded":"2024-09-16T07:45:44.530368+0000","last_fullsized":"2024-09-16T07:45:44.530368+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"45'352","reported_seq":364,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.114771+0000","last_change":"2024-09-16T07:45:20.441791+0000","last_active":"2024-09-16T07:45:43.114771+0000","last_peered":"2024-09-16T07:45:43.114771+0000","last_clean":"2024-09-16T07:45:43.114771+0000","last_became_active":"2024-09-16T07:45:20.430403+0000","last_became_peered":"2024-09-16T07:45:20.430403+0000","last_unstale":"2024-09-16T07:45:43.114771+0000","last_undegraded":"2024-09-16T07:45:43.114771+0000","last_fullsized":"2024-09-16T07:45:43.114771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.411814+0000","last_change":"2024-09-16T07:45:20.448632+0000","last_active":"2024-09-16T07:45:44.411814+0000","last_peered":"2024-09-16T07:45:44.411814+0000","last_clean":"2024-09-16T07:45:44.411814+0000","last_became_active":"2024-09-16T07:45:20.436131+0000","last_became_peered":"2024-09-16T07:45:20.436131+0000","last_unstale":"2024-09-16T07:45:44.411814+0000","last_undegraded":"2024-09-16T07:45:44.411814+0000","last_fullsized":"2024-09-16T07:45:44.411814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.372708+0000","last_change":"2024-09-16T07:45:20.501623+0000","last_active":"2024-09-16T07:45:44.372708+0000","last_peered":"2024-09-16T07:45:44.372708+0000","last_clean":"2024-09-16T07:45:44.372708+0000","last_became_active":"2024-09-16T07:45:20.494483+0000","last_became_peered":"2024-09-16T07:45:20.494483+0000","last_unstale":"2024-09-16T07:45:44.372708+0000","last_undegraded":"2024-09-16T07:45:44.372708+0000","last_fullsized":"2024-09-16T07:45:44.372708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"45'168","reported_seq":180,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.698224+0000","last_change":"2024-09-16T07:45:20.478109+0000","last_active":"2024-09-16T07:45:44.698224+0000","last_peered":"2024-09-16T07:45:44.698224+0000","last_clean":"2024-09-16T07:45:44.698224+0000","last_became_active":"2024-09-16T07:45:20.471340+0000","last_became_peered":"2024-09-16T07:45:20.471340+0000","last_unstale":"2024-09-16T07:45:44.698224+0000","last_undegraded":"2024-09-16T07:45:44.698224+0000","last_fullsized":"2024-09-16T07:45:44.698224+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.651406+0000","last_change":"2024-09-16T07:45:20.425615+0000","last_active":"2024-09-16T07:45:44.651406+0000","last_peered":"2024-09-16T07:45:44.651406+0000","last_clean":"2024-09-16T07:45:44.651406+0000","last_became_active":"2024-09-16T07:45:20.415753+0000","last_became_peered":"2024-09-16T07:45:20.415753+0000","last_unstale":"2024-09-16T07:45:44.651406+0000","last_undegraded":"2024-09-16T07:45:44.651406+0000","last_fullsized":"2024-09-16T07:45:44.651406+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"45'264","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.377809+0000","last_change":"2024-09-16T07:45:20.428249+0000","last_active":"2024-09-16T07:45:43.377809+0000","last_peered":"2024-09-16T07:45:43.377809+0000","last_clean":"2024-09-16T07:45:43.377809+0000","last_became_active":"2024-09-16T07:45:20.420592+0000","last_became_peered":"2024-09-16T07:45:20.420592+0000","last_unstale":"2024-09-16T07:45:43.377809+0000","last_undegraded":"2024-09-16T07:45:43.377809+0000","last_fullsized":"2024-09-16T07:45:43.377809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.460187+0000","last_change":"2024-09-16T07:45:20.452728+0000","last_active":"2024-09-16T07:45:44.460187+0000","last_peered":"2024-09-16T07:45:44.460187+0000","last_clean":"2024-09-16T07:45:44.460187+0000","last_became_active":"2024-09-16T07:45:20.442417+0000","last_became_peered":"2024-09-16T07:45:20.442417+0000","last_unstale":"2024-09-16T07:45:44.460187+0000","last_undegraded":"2024-09-16T07:45:44.460187+0000","last_fullsized":"2024-09-16T07:45:44.460187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"45'264","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.345137+0000","last_change":"2024-09-16T07:45:20.454595+0000","last_active":"2024-09-16T07:45:44.345137+0000","last_peered":"2024-09-16T07:45:44.345137+0000","last_clean":"2024-09-16T07:45:44.345137+0000","last_became_active":"2024-09-16T07:45:20.442809+0000","last_became_peered":"2024-09-16T07:45:20.442809+0000","last_unstale":"2024-09-16T07:45:44.345137+0000","last_undegraded":"2024-09-16T07:45:44.345137+0000","last_fullsized":"2024-09-16T07:45:44.345137+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"45'208","reported_seq":220,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.234950+0000","last_change":"2024-09-16T07:45:20.460812+0000","last_active":"2024-09-16T07:45:43.234950+0000","last_peered":"2024-09-16T07:45:43.234950+0000","last_clean":"2024-09-16T07:45:43.234950+0000","last_became_active":"2024-09-16T07:45:20.448491+0000","last_became_peered":"2024-09-16T07:45:20.448491+0000","last_unstale":"2024-09-16T07:45:43.234950+0000","last_undegraded":"2024-09-16T07:45:43.234950+0000","last_fullsized":"2024-09-16T07:45:43.234950+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":35078144,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4282,"num_write_kb":34256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52596736,"data_stored":105193472,"data_compressed":5428413,"data_compressed_allocated":52596736,"data_compressed_original":105193472,"omap_allocated":0,"internal_metadata":0},"log_size":4282,"ondisk_log_size":4282,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79772,"kb_used_data":12684,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94292068,"statfs":{"total":96636764160,"available":96555077632,"internally_reserved":0,"allocated":12988416,"data_stored":25335372,"data_compressed":1300344,"data_compressed_allocated":12599296,"data_compressed_original":25198592,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89908,"kb_used_data":14500,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94281932,"statfs":{"total":96636764160,"available":96544698368,"internally_reserved":0,"allocated":14848000,"data_stored":29522028,"data_compressed":1515916,"data_compressed_allocated":14438400,"data_compressed_original":29368320,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79896,"kb_used_data":12808,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94291944,"statfs":{"total":96636764160,"available":96554950656,"internally_reserved":0,"allocated":13115392,"data_stored":26056812,"data_compressed":1337147,"data_compressed_allocated":12705792,"data_compressed_original":25903104,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83428,"kb_used_data":12180,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94288412,"statfs":{"total":96636764160,"available":96551333888,"internally_reserved":0,"allocated":12472320,"data_stored":24778841,"data_compressed":1271211,"data_compressed_allocated":12066816,"data_compressed_original":24625152,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288000,"data_stored":24576000,"data_compressed":1268246,"data_compressed_allocated":12288000,"data_compressed_original":24576000,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12926976,"data_stored":25853952,"data_compressed":1334182,"data_compressed_allocated":12926976,"data_compressed_original":25853952,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14524416,"data_stored":29048832,"data_compressed":1498992,"data_compressed_allocated":14524416,"data_compressed_original":29048832,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":25714688,"data_compressed":1326993,"data_compressed_allocated":12857344,"data_compressed_original":25714688,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:45:57.165 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:45:57.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:57.306+0000 7f9a54b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:57.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:57.315+0000 7f9a54b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:57.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 36 16 6530 6514 1.4135 1.32031 0.0902209 0.0883292 2024-09-16T07:45:58.388 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 37 16 6711 6695 1.41351 1.41406 0.0765451 0.08833 2024-09-16T07:45:59.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 38 16 6888 6872 1.4127 1.38281 0.161536 0.0883649 2024-09-16T07:45:59.497 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:45:59.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:59.645+0000 7f5ffd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:45:59.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:45:59.656+0000 7f5ffd151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:00.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 39 16 7041 7025 1.40713 1.19531 0.0930334 0.0886647 2024-09-16T07:46:01.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:46:01.390650+0000 min lat: 0.0206628 max lat: 0.271629 avg lat: 0.0887795 2024-09-16T07:46:01.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:46:01.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 40 16 7218 7202 1.40652 1.38281 0.0991544 0.0887795 2024-09-16T07:46:01.772 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:01.772 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:01.772 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:46:01.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:46:01.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:01.904+0000 7f66d7511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:01.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:01.914+0000 7f66d7511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:01.937 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:01.941 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:01.942 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:01.942 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:46:02.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:02.104+0000 7f4b3ee9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:02.121+0000 7f4b3ee9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:02.201 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:02.201 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:02.202 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:02.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:02.206 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:02.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:46:02.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:02.305+0000 7fb351023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:02.316+0000 7fb351023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 41 16 7391 7375 1.40517 1.35156 0.0623933 0.0888566 2024-09-16T07:46:02.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:02.399+0000 7fc40e65c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:02.414+0000 7fc40e65c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.468 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:02.469 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:02.470 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:02.470 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:02.470 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:02.474 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:02.474 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:02.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:46:02.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:02.594+0000 7fc345991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:02.604+0000 7fc345991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:02.637 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:02.638 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:02.640 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:02.640 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:03.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 42 16 7552 7536 1.40166 1.25781 0.18287 0.088983 2024-09-16T07:46:04.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 43 16 7730 7714 1.4014 1.39062 0.141422 0.0890505 2024-09-16T07:46:04.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:04.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:04.827+0000 7fcdab191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:04.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:04.834+0000 7fcdab191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:05.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 44 16 7875 7859 1.39529 1.13281 0.112704 0.0894826 2024-09-16T07:46:06.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 45 16 8059 8043 1.39623 1.4375 0.0650436 0.0894766 2024-09-16T07:46:07.084 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:07.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:07.242+0000 7f57e8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:07.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:07.249+0000 7f57e8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:07.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 46 16 8225 8209 1.39407 1.29688 0.083351 0.0895712 2024-09-16T07:46:07.641 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:07.641 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:07.641 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:46:07.642 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:46:07.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:07.792+0000 7f4737b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:07.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:07.808+0000 7f4737b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:07.917 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:07.917 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:07.917 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:07.917 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:07.917 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:07.918 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:07.918 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:07.918 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:07.918 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:07.918 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:07.918 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:07.918 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:07.921 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:07.921 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:07.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:46:08.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:08.074+0000 7fac09f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:08.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:08.086+0000 7fac09f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:08.104 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:08.104 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:08.104 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:08.104 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:08.105 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:08.105 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:08.105 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:08.105 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:08.105 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:08.105 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:08.105 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:08.105 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:08.107 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:08.108 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:08.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:46:08.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:08.238+0000 7f6d7b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:08.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:08.253+0000 7f6d7b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:08.284 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:08.284 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:08.284 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:08.284 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:08.284 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:08.284 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:08.284 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:08.284 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:08.285 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:08.285 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:08.285 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:08.285 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:08.288 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:08.288 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:08.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:46:08.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 47 16 8390 8374 1.39183 1.28906 0.155922 0.0895748 2024-09-16T07:46:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:08.417+0000 7f639bcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:08.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:08.430+0000 7f639bcbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:08.558 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:08.558 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:08.558 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:08.558 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:08.558 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:08.558 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:08.558 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:08.558 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:08.559 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:08.559 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:08.559 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:08.559 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:08.561 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:08.562 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:09.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 48 16 8554 8538 1.38952 1.28125 0.0567272 0.0898638 2024-09-16T07:46:09.462 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:09.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:09.595+0000 7f004f748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:09.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:09.603+0000 7f004f748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:10.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 49 16 8731 8715 1.38938 1.38281 0.0557906 0.0898568 2024-09-16T07:46:11.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 50 16 8882 8866 1.38519 1.17969 0.150303 0.09013 2024-09-16T07:46:11.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:12.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:12.024+0000 7f66f7708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:12.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:12.032+0000 7f66f7708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:12.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 51 16 9049 9033 1.38361 1.30469 0.0617171 0.0901912 2024-09-16T07:46:13.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 52 16 9201 9185 1.37983 1.1875 0.061259 0.0904419 2024-09-16T07:46:13.562 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:13.563 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:13.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:13.701+0000 7f2f72246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:13.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:13.715+0000 7f2f72246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:13.937 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:46:13.938 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:46:13.953 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-09-16T07:46:13.771703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35668531,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4363,"num_write_kb":35364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4337,"ondisk_log_size":4337,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":333004,"kb_used_data":52172,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377154356,"statfs":{"total":386547056640,"available":386206060544,"internally_reserved":0,"allocated":53424128,"data_stored":105693053,"data_compressed":5424618,"data_compressed_allocated":51810304,"data_compressed_original":105095168,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002504"},"pg_stats":[{"pgid":"6.f","version":"45'266","reported_seq":278,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.736641+0000","last_change":"2024-09-16T07:45:20.518363+0000","last_active":"2024-09-16T07:45:44.736641+0000","last_peered":"2024-09-16T07:45:44.736641+0000","last_clean":"2024-09-16T07:45:44.736641+0000","last_became_active":"2024-09-16T07:45:20.511671+0000","last_became_peered":"2024-09-16T07:45:20.511671+0000","last_unstale":"2024-09-16T07:45:44.736641+0000","last_undegraded":"2024-09-16T07:45:44.736641+0000","last_fullsized":"2024-09-16T07:45:44.736641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179072,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":2128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"45'328","reported_seq":340,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.740949+0000","last_change":"2024-09-16T07:45:20.429293+0000","last_active":"2024-09-16T07:45:44.740949+0000","last_peered":"2024-09-16T07:45:44.740949+0000","last_clean":"2024-09-16T07:45:44.740949+0000","last_became_active":"2024-09-16T07:45:20.417784+0000","last_became_peered":"2024-09-16T07:45:20.417784+0000","last_unstale":"2024-09-16T07:45:44.740949+0000","last_undegraded":"2024-09-16T07:45:44.740949+0000","last_fullsized":"2024-09-16T07:45:44.740949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.049968+0000","last_change":"2024-09-16T07:45:20.434860+0000","last_active":"2024-09-16T07:45:44.049968+0000","last_peered":"2024-09-16T07:45:44.049968+0000","last_clean":"2024-09-16T07:45:44.049968+0000","last_became_active":"2024-09-16T07:45:20.424106+0000","last_became_peered":"2024-09-16T07:45:20.424106+0000","last_unstale":"2024-09-16T07:45:44.049968+0000","last_undegraded":"2024-09-16T07:45:44.049968+0000","last_fullsized":"2024-09-16T07:45:44.049968+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"45'272","reported_seq":284,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.274008+0000","last_change":"2024-09-16T07:45:20.515551+0000","last_active":"2024-09-16T07:45:44.274008+0000","last_peered":"2024-09-16T07:45:44.274008+0000","last_clean":"2024-09-16T07:45:44.274008+0000","last_became_active":"2024-09-16T07:45:20.507157+0000","last_became_peered":"2024-09-16T07:45:20.507157+0000","last_unstale":"2024-09-16T07:45:44.274008+0000","last_undegraded":"2024-09-16T07:45:44.274008+0000","last_fullsized":"2024-09-16T07:45:44.274008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"45'144","reported_seq":156,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.425370+0000","last_change":"2024-09-16T07:45:20.483112+0000","last_active":"2024-09-16T07:45:43.425370+0000","last_peered":"2024-09-16T07:45:43.425370+0000","last_clean":"2024-09-16T07:45:43.425370+0000","last_became_active":"2024-09-16T07:45:20.469905+0000","last_became_peered":"2024-09-16T07:45:20.469905+0000","last_unstale":"2024-09-16T07:45:43.425370+0000","last_undegraded":"2024-09-16T07:45:43.425370+0000","last_fullsized":"2024-09-16T07:45:43.425370+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.297811+0000","last_change":"2024-09-16T07:45:20.419879+0000","last_active":"2024-09-16T07:45:44.297811+0000","last_peered":"2024-09-16T07:45:44.297811+0000","last_clean":"2024-09-16T07:45:44.297811+0000","last_became_active":"2024-09-16T07:45:20.414183+0000","last_became_peered":"2024-09-16T07:45:20.414183+0000","last_unstale":"2024-09-16T07:45:44.297811+0000","last_undegraded":"2024-09-16T07:45:44.297811+0000","last_fullsized":"2024-09-16T07:45:44.297811+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"45'288","reported_seq":300,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.530368+0000","last_change":"2024-09-16T07:45:20.421367+0000","last_active":"2024-09-16T07:45:44.530368+0000","last_peered":"2024-09-16T07:45:44.530368+0000","last_clean":"2024-09-16T07:45:44.530368+0000","last_became_active":"2024-09-16T07:45:20.411622+0000","last_became_peered":"2024-09-16T07:45:20.411622+0000","last_unstale":"2024-09-16T07:45:44.530368+0000","last_undegraded":"2024-09-16T07:45:44.530368+0000","last_fullsized":"2024-09-16T07:45:44.530368+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"45'352","reported_seq":364,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.114771+0000","last_change":"2024-09-16T07:45:20.441791+0000","last_active":"2024-09-16T07:45:43.114771+0000","last_peered":"2024-09-16T07:45:43.114771+0000","last_clean":"2024-09-16T07:45:43.114771+0000","last_became_active":"2024-09-16T07:45:20.430403+0000","last_became_peered":"2024-09-16T07:45:20.430403+0000","last_unstale":"2024-09-16T07:45:43.114771+0000","last_undegraded":"2024-09-16T07:45:43.114771+0000","last_fullsized":"2024-09-16T07:45:43.114771+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.411814+0000","last_change":"2024-09-16T07:45:20.448632+0000","last_active":"2024-09-16T07:45:44.411814+0000","last_peered":"2024-09-16T07:45:44.411814+0000","last_clean":"2024-09-16T07:45:44.411814+0000","last_became_active":"2024-09-16T07:45:20.436131+0000","last_became_peered":"2024-09-16T07:45:20.436131+0000","last_unstale":"2024-09-16T07:45:44.411814+0000","last_undegraded":"2024-09-16T07:45:44.411814+0000","last_fullsized":"2024-09-16T07:45:44.411814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"45'296","reported_seq":308,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.372708+0000","last_change":"2024-09-16T07:45:20.501623+0000","last_active":"2024-09-16T07:45:44.372708+0000","last_peered":"2024-09-16T07:45:44.372708+0000","last_clean":"2024-09-16T07:45:44.372708+0000","last_became_active":"2024-09-16T07:45:20.494483+0000","last_became_peered":"2024-09-16T07:45:20.494483+0000","last_unstale":"2024-09-16T07:45:44.372708+0000","last_undegraded":"2024-09-16T07:45:44.372708+0000","last_fullsized":"2024-09-16T07:45:44.372708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"45'168","reported_seq":180,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.698224+0000","last_change":"2024-09-16T07:45:20.478109+0000","last_active":"2024-09-16T07:45:44.698224+0000","last_peered":"2024-09-16T07:45:44.698224+0000","last_clean":"2024-09-16T07:45:44.698224+0000","last_became_active":"2024-09-16T07:45:20.471340+0000","last_became_peered":"2024-09-16T07:45:20.471340+0000","last_unstale":"2024-09-16T07:45:44.698224+0000","last_undegraded":"2024-09-16T07:45:44.698224+0000","last_fullsized":"2024-09-16T07:45:44.698224+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.651406+0000","last_change":"2024-09-16T07:45:20.425615+0000","last_active":"2024-09-16T07:45:44.651406+0000","last_peered":"2024-09-16T07:45:44.651406+0000","last_clean":"2024-09-16T07:45:44.651406+0000","last_became_active":"2024-09-16T07:45:20.415753+0000","last_became_peered":"2024-09-16T07:45:20.415753+0000","last_unstale":"2024-09-16T07:45:44.651406+0000","last_undegraded":"2024-09-16T07:45:44.651406+0000","last_fullsized":"2024-09-16T07:45:44.651406+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"45'264","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.377809+0000","last_change":"2024-09-16T07:45:20.428249+0000","last_active":"2024-09-16T07:45:43.377809+0000","last_peered":"2024-09-16T07:45:43.377809+0000","last_clean":"2024-09-16T07:45:43.377809+0000","last_became_active":"2024-09-16T07:45:20.420592+0000","last_became_peered":"2024-09-16T07:45:20.420592+0000","last_unstale":"2024-09-16T07:45:43.377809+0000","last_undegraded":"2024-09-16T07:45:43.377809+0000","last_fullsized":"2024-09-16T07:45:43.377809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"45'280","reported_seq":292,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.460187+0000","last_change":"2024-09-16T07:45:20.452728+0000","last_active":"2024-09-16T07:45:44.460187+0000","last_peered":"2024-09-16T07:45:44.460187+0000","last_clean":"2024-09-16T07:45:44.460187+0000","last_became_active":"2024-09-16T07:45:20.442417+0000","last_became_peered":"2024-09-16T07:45:20.442417+0000","last_unstale":"2024-09-16T07:45:44.460187+0000","last_undegraded":"2024-09-16T07:45:44.460187+0000","last_fullsized":"2024-09-16T07:45:44.460187+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"45'264","reported_seq":276,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:44.345137+0000","last_change":"2024-09-16T07:45:20.454595+0000","last_active":"2024-09-16T07:45:44.345137+0000","last_peered":"2024-09-16T07:45:44.345137+0000","last_clean":"2024-09-16T07:45:44.345137+0000","last_became_active":"2024-09-16T07:45:20.442809+0000","last_became_peered":"2024-09-16T07:45:20.442809+0000","last_unstale":"2024-09-16T07:45:44.345137+0000","last_undegraded":"2024-09-16T07:45:44.345137+0000","last_fullsized":"2024-09-16T07:45:44.345137+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"45'208","reported_seq":220,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:43.234950+0000","last_change":"2024-09-16T07:45:20.460812+0000","last_active":"2024-09-16T07:45:43.234950+0000","last_peered":"2024-09-16T07:45:43.234950+0000","last_clean":"2024-09-16T07:45:43.234950+0000","last_became_active":"2024-09-16T07:45:20.448491+0000","last_became_peered":"2024-09-16T07:45:20.448491+0000","last_unstale":"2024-09-16T07:45:43.234950+0000","last_undegraded":"2024-09-16T07:45:43.234950+0000","last_fullsized":"2024-09-16T07:45:43.234950+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":35078144,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4282,"num_write_kb":34256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52596736,"data_stored":105193472,"data_compressed":5428413,"data_compressed_allocated":52596736,"data_compressed_original":105193472,"omap_allocated":0,"internal_metadata":0},"log_size":4282,"ondisk_log_size":4282,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79772,"kb_used_data":12684,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94292068,"statfs":{"total":96636764160,"available":96555077632,"internally_reserved":0,"allocated":12988416,"data_stored":25335372,"data_compressed":1300344,"data_compressed_allocated":12599296,"data_compressed_original":25198592,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89908,"kb_used_data":14500,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94281932,"statfs":{"total":96636764160,"available":96544698368,"internally_reserved":0,"allocated":14848000,"data_stored":29522028,"data_compressed":1515916,"data_compressed_allocated":14438400,"data_compressed_original":29368320,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79896,"kb_used_data":12808,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94291944,"statfs":{"total":96636764160,"available":96554950656,"internally_reserved":0,"allocated":13115392,"data_stored":26056812,"data_compressed":1337147,"data_compressed_allocated":12705792,"data_compressed_original":25903104,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83428,"kb_used_data":12180,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94288412,"statfs":{"total":96636764160,"available":96551333888,"internally_reserved":0,"allocated":12472320,"data_stored":24778841,"data_compressed":1271211,"data_compressed_allocated":12066816,"data_compressed_original":24625152,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288000,"data_stored":24576000,"data_compressed":1268246,"data_compressed_allocated":12288000,"data_compressed_original":24576000,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12926976,"data_stored":25853952,"data_compressed":1334182,"data_compressed_allocated":12926976,"data_compressed_original":25853952,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14524416,"data_stored":29048832,"data_compressed":1498992,"data_compressed_allocated":14524416,"data_compressed_original":29048832,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12857344,"data_stored":25714688,"data_compressed":1326993,"data_compressed_allocated":12857344,"data_compressed_original":25714688,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:14.245 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:14.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:14.367+0000 7f890a2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:14.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:14.373+0000 7f890a2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:14.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 53 16 9361 9345 1.37738 1.25 0.191523 0.0905537 2024-09-16T07:46:15.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 54 16 9531 9515 1.37647 1.32812 0.109615 0.0906952 2024-09-16T07:46:16.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 55 16 9689 9673 1.37388 1.23438 0.169291 0.090846 2024-09-16T07:46:16.670 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:16.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:16.822+0000 7f73dc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:16.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:16.831+0000 7f73dc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:17.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 56 16 9843 9827 1.37083 1.20312 0.0329624 0.0910429 2024-09-16T07:46:18.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 57 16 10016 10000 1.37049 1.35156 0.136441 0.09108 2024-09-16T07:46:18.955 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:18.955 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:18.955 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:46:18.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:46:19.110 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:19.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.118+0000 7f92e8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.132+0000 7f92e8991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.262+0000 7f5618874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.272+0000 7f5618874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:19.370 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:19.371 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:19.371 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:19.371 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:19.371 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:19.371 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:19.371 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:19.371 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:19.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:19.374 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:19.375 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:46:19.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 58 16 10176 10160 1.36841 1.25 0.179119 0.0912284 2024-09-16T07:46:19.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.539+0000 7f49f7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.554+0000 7f49f7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:19.577 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:19.581 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:19.581 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:19.582 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:46:19.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.743+0000 7fe59f551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.755+0000 7fe59f551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.780 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:19.780 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:19.780 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:19.780 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:19.780 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:19.781 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:19.784 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:19.784 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:19.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:46:19.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.912+0000 7fd1cba46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:19.924+0000 7fd1cba46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:19.987 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:19.988 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:19.989 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:19.991 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:19.992 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:20.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 59 16 10327 10311 1.36521 1.17969 0.0929067 0.0914745 2024-09-16T07:46:21.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:46:21.392552+0000 min lat: 0.0202414 max lat: 0.30697 avg lat: 0.0915148 2024-09-16T07:46:21.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:46:21.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 60 16 10497 10481 1.36459 1.32812 0.092691 0.0915148 2024-09-16T07:46:21.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:21.648+0000 7f16d2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:21.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:21.658+0000 7f16d2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:22.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 61 16 10645 10629 1.36117 1.15625 0.0899825 0.0917445 2024-09-16T07:46:23.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 62 16 10815 10799 1.36064 1.32812 0.183213 0.0918045 2024-09-16T07:46:24.199 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:24.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:24.338+0000 7f7ff8511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:24.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:24.346+0000 7f7ff8511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:24.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 63 16 10970 10954 1.35826 1.21094 0.0682193 0.0919482 2024-09-16T07:46:24.993 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:24.993 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:24.994 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:46:24.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:46:25.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:25.168+0000 7f9a1f2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:25.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:25.181+0000 7f9a1f2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:25.217 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:25.221 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:25.222 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:25.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:46:25.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 64 16 11128 11112 1.35632 1.23438 0.131194 0.0920774 2024-09-16T07:46:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:25.386+0000 7f06b3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:25.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:25.400+0000 7f06b3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:25.432 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:25.433 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:25.433 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:25.433 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:25.433 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:25.433 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:25.433 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:25.433 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:25.434 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:25.434 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:25.434 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:25.434 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:25.437 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:25.437 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:25.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:46:25.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:25.564+0000 7fe671b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:25.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:25.576+0000 7fe671b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:25.598 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:25.599 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:25.602 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:25.602 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:25.602 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:46:25.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:25.724+0000 7fb8f6d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:25.750+0000 7fb8f6d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:25.797 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:25.797 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:25.797 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:25.797 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:25.797 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:25.798 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:25.801 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:25.801 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:26.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 65 16 11286 11270 1.35444 1.23438 0.134271 0.0922337 2024-09-16T07:46:26.540 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:26.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:26.677+0000 7f6698f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:26.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:26.684+0000 7f6698f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:27.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 66 16 11448 11432 1.3531 1.26562 0.0791987 0.0923198 2024-09-16T07:46:28.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 67 16 11599 11583 1.35051 1.17969 0.0632635 0.0924871 2024-09-16T07:46:28.861 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:28.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:28.988+0000 7fcf8dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:28.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:28.997+0000 7fcf8dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:29.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 68 16 11744 11728 1.3473 1.13281 0.102303 0.0926892 2024-09-16T07:46:30.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 69 16 11907 11891 1.34623 1.27344 0.129529 0.0927764 2024-09-16T07:46:30.802 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:30.802 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:30.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:30.955+0000 7f3dd2abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:30.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:30.967+0000 7f3dd2abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:31.213 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:46:31.214 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:46:31.238 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-09-16T07:46:29.774897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":77791795,"num_objects":1183,"num_object_clones":0,"num_object_copies":3549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9505,"num_write_kb":76500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9479,"ondisk_log_size":9479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":400344,"kb_used_data":113944,"kb_used_omap":0,"kb_used_meta":286336,"kb_avail":377087016,"statfs":{"total":386547056640,"available":386137104384,"internally_reserved":0,"allocated":116678656,"data_stored":232202109,"data_compressed":11957007,"data_compressed_allocated":115064832,"data_compressed_original":231604224,"omap_allocated":0,"internal_metadata":293208064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002357"},"pg_stats":[{"pgid":"6.f","version":"45'592","reported_seq":604,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.739486+0000","last_change":"2024-09-16T07:45:20.518363+0000","last_active":"2024-09-16T07:46:13.739486+0000","last_peered":"2024-09-16T07:46:13.739486+0000","last_clean":"2024-09-16T07:46:13.739486+0000","last_became_active":"2024-09-16T07:45:20.511671+0000","last_became_peered":"2024-09-16T07:45:20.511671+0000","last_unstale":"2024-09-16T07:46:13.739486+0000","last_undegraded":"2024-09-16T07:46:13.739486+0000","last_fullsized":"2024-09-16T07:46:13.739486+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"45'648","reported_seq":660,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.015821+0000","last_change":"2024-09-16T07:45:20.429293+0000","last_active":"2024-09-16T07:46:14.015821+0000","last_peered":"2024-09-16T07:46:14.015821+0000","last_clean":"2024-09-16T07:46:14.015821+0000","last_became_active":"2024-09-16T07:45:20.417784+0000","last_became_peered":"2024-09-16T07:45:20.417784+0000","last_unstale":"2024-09-16T07:46:14.015821+0000","last_undegraded":"2024-09-16T07:46:14.015821+0000","last_fullsized":"2024-09-16T07:46:14.015821+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'688","reported_seq":700,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.666166+0000","last_change":"2024-09-16T07:45:20.434860+0000","last_active":"2024-09-16T07:46:13.666166+0000","last_peered":"2024-09-16T07:46:13.666166+0000","last_clean":"2024-09-16T07:46:13.666166+0000","last_became_active":"2024-09-16T07:45:20.424106+0000","last_became_peered":"2024-09-16T07:45:20.424106+0000","last_unstale":"2024-09-16T07:46:13.666166+0000","last_undegraded":"2024-09-16T07:46:13.666166+0000","last_fullsized":"2024-09-16T07:46:13.666166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"45'568","reported_seq":580,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.729052+0000","last_change":"2024-09-16T07:45:20.515551+0000","last_active":"2024-09-16T07:46:14.729052+0000","last_peered":"2024-09-16T07:46:14.729052+0000","last_clean":"2024-09-16T07:46:14.729052+0000","last_became_active":"2024-09-16T07:45:20.507157+0000","last_became_peered":"2024-09-16T07:45:20.507157+0000","last_unstale":"2024-09-16T07:46:14.729052+0000","last_undegraded":"2024-09-16T07:46:14.729052+0000","last_fullsized":"2024-09-16T07:46:14.729052+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"45'472","reported_seq":484,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:12.769900+0000","last_change":"2024-09-16T07:45:20.483112+0000","last_active":"2024-09-16T07:46:12.769900+0000","last_peered":"2024-09-16T07:46:12.769900+0000","last_clean":"2024-09-16T07:46:12.769900+0000","last_became_active":"2024-09-16T07:45:20.469905+0000","last_became_peered":"2024-09-16T07:45:20.469905+0000","last_unstale":"2024-09-16T07:46:12.769900+0000","last_undegraded":"2024-09-16T07:46:12.769900+0000","last_fullsized":"2024-09-16T07:46:12.769900+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"45'616","reported_seq":628,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.010425+0000","last_change":"2024-09-16T07:45:20.419879+0000","last_active":"2024-09-16T07:46:13.010425+0000","last_peered":"2024-09-16T07:46:13.010425+0000","last_clean":"2024-09-16T07:46:13.010425+0000","last_became_active":"2024-09-16T07:45:20.414183+0000","last_became_peered":"2024-09-16T07:45:20.414183+0000","last_unstale":"2024-09-16T07:46:13.010425+0000","last_undegraded":"2024-09-16T07:46:13.010425+0000","last_fullsized":"2024-09-16T07:46:13.010425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"45'568","reported_seq":580,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.213596+0000","last_change":"2024-09-16T07:45:20.421367+0000","last_active":"2024-09-16T07:46:13.213596+0000","last_peered":"2024-09-16T07:46:13.213596+0000","last_clean":"2024-09-16T07:46:13.213596+0000","last_became_active":"2024-09-16T07:45:20.411622+0000","last_became_peered":"2024-09-16T07:45:20.411622+0000","last_unstale":"2024-09-16T07:46:13.213596+0000","last_undegraded":"2024-09-16T07:46:13.213596+0000","last_fullsized":"2024-09-16T07:46:13.213596+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"45'752","reported_seq":764,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.505422+0000","last_change":"2024-09-16T07:45:20.441791+0000","last_active":"2024-09-16T07:46:14.505422+0000","last_peered":"2024-09-16T07:46:14.505422+0000","last_clean":"2024-09-16T07:46:14.505422+0000","last_became_active":"2024-09-16T07:45:20.430403+0000","last_became_peered":"2024-09-16T07:45:20.430403+0000","last_unstale":"2024-09-16T07:46:14.505422+0000","last_undegraded":"2024-09-16T07:46:14.505422+0000","last_fullsized":"2024-09-16T07:46:14.505422+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"45'626","reported_seq":638,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.739575+0000","last_change":"2024-09-16T07:45:20.448632+0000","last_active":"2024-09-16T07:46:14.739575+0000","last_peered":"2024-09-16T07:46:14.739575+0000","last_clean":"2024-09-16T07:46:14.739575+0000","last_became_active":"2024-09-16T07:45:20.436131+0000","last_became_peered":"2024-09-16T07:45:20.436131+0000","last_unstale":"2024-09-16T07:46:14.739575+0000","last_undegraded":"2024-09-16T07:46:14.739575+0000","last_fullsized":"2024-09-16T07:46:14.739575+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5128192,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":5008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"45'632","reported_seq":644,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.656331+0000","last_change":"2024-09-16T07:45:20.501623+0000","last_active":"2024-09-16T07:46:14.656331+0000","last_peered":"2024-09-16T07:46:14.656331+0000","last_clean":"2024-09-16T07:46:14.656331+0000","last_became_active":"2024-09-16T07:45:20.494483+0000","last_became_peered":"2024-09-16T07:45:20.494483+0000","last_unstale":"2024-09-16T07:46:14.656331+0000","last_undegraded":"2024-09-16T07:46:14.656331+0000","last_fullsized":"2024-09-16T07:46:14.656331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"45'416","reported_seq":428,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.602030+0000","last_change":"2024-09-16T07:45:20.478109+0000","last_active":"2024-09-16T07:46:14.602030+0000","last_peered":"2024-09-16T07:46:14.602030+0000","last_clean":"2024-09-16T07:46:14.602030+0000","last_became_active":"2024-09-16T07:45:20.471340+0000","last_became_peered":"2024-09-16T07:45:20.471340+0000","last_unstale":"2024-09-16T07:46:14.602030+0000","last_undegraded":"2024-09-16T07:46:14.602030+0000","last_fullsized":"2024-09-16T07:46:14.602030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"45'536","reported_seq":548,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.386607+0000","last_change":"2024-09-16T07:45:20.425615+0000","last_active":"2024-09-16T07:46:14.386607+0000","last_peered":"2024-09-16T07:46:14.386607+0000","last_clean":"2024-09-16T07:46:14.386607+0000","last_became_active":"2024-09-16T07:45:20.415753+0000","last_became_peered":"2024-09-16T07:45:20.415753+0000","last_unstale":"2024-09-16T07:46:14.386607+0000","last_undegraded":"2024-09-16T07:46:14.386607+0000","last_fullsized":"2024-09-16T07:46:14.386607+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"45'640","reported_seq":652,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.495686+0000","last_change":"2024-09-16T07:45:20.428249+0000","last_active":"2024-09-16T07:46:14.495686+0000","last_peered":"2024-09-16T07:46:14.495686+0000","last_clean":"2024-09-16T07:46:14.495686+0000","last_became_active":"2024-09-16T07:45:20.420592+0000","last_became_peered":"2024-09-16T07:45:20.420592+0000","last_unstale":"2024-09-16T07:46:14.495686+0000","last_undegraded":"2024-09-16T07:46:14.495686+0000","last_fullsized":"2024-09-16T07:46:14.495686+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"45'590","reported_seq":602,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.744850+0000","last_change":"2024-09-16T07:45:20.452728+0000","last_active":"2024-09-16T07:46:14.744850+0000","last_peered":"2024-09-16T07:46:14.744850+0000","last_clean":"2024-09-16T07:46:14.744850+0000","last_became_active":"2024-09-16T07:45:20.442417+0000","last_became_peered":"2024-09-16T07:45:20.442417+0000","last_unstale":"2024-09-16T07:46:14.744850+0000","last_undegraded":"2024-09-16T07:46:14.744850+0000","last_fullsized":"2024-09-16T07:46:14.744850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4833280,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":4720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"45'616","reported_seq":628,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.559973+0000","last_change":"2024-09-16T07:45:20.454595+0000","last_active":"2024-09-16T07:46:14.559973+0000","last_peered":"2024-09-16T07:46:14.559973+0000","last_clean":"2024-09-16T07:46:14.559973+0000","last_became_active":"2024-09-16T07:45:20.442809+0000","last_became_peered":"2024-09-16T07:45:20.442809+0000","last_unstale":"2024-09-16T07:46:14.559973+0000","last_undegraded":"2024-09-16T07:46:14.559973+0000","last_fullsized":"2024-09-16T07:46:14.559973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"45'464","reported_seq":476,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.382364+0000","last_change":"2024-09-16T07:45:20.460812+0000","last_active":"2024-09-16T07:46:13.382364+0000","last_peered":"2024-09-16T07:46:13.382364+0000","last_clean":"2024-09-16T07:46:13.382364+0000","last_became_active":"2024-09-16T07:45:20.448491+0000","last_became_peered":"2024-09-16T07:45:20.448491+0000","last_unstale":"2024-09-16T07:46:13.382364+0000","last_undegraded":"2024-09-16T07:46:13.382364+0000","last_fullsized":"2024-09-16T07:46:13.382364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":77201408,"num_objects":1179,"num_object_clones":0,"num_object_copies":3537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9424,"num_write_kb":75392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":115793920,"data_stored":231587840,"data_compressed":11954880,"data_compressed_allocated":115793920,"data_compressed_original":231587840,"omap_allocated":0,"internal_metadata":0},"log_size":9424,"ondisk_log_size":9424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108660,"kb_used_data":27684,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94263180,"statfs":{"total":96636764160,"available":96525496320,"internally_reserved":0,"allocated":28348416,"data_stored":56055372,"data_compressed":2886594,"data_compressed_allocated":27959296,"data_compressed_original":55918592,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107276,"kb_used_data":31868,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94264564,"statfs":{"total":96636764160,"available":96526913536,"internally_reserved":0,"allocated":32632832,"data_stored":65091692,"data_compressed":3352582,"data_compressed_allocated":32223232,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91072,"kb_used_data":28144,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94280768,"statfs":{"total":96636764160,"available":96543506432,"internally_reserved":0,"allocated":28819456,"data_stored":57464940,"data_compressed":2958929,"data_compressed_allocated":28409856,"data_compressed_original":57311232,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93336,"kb_used_data":26248,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94278504,"statfs":{"total":96636764160,"available":96541188096,"internally_reserved":0,"allocated":26877952,"data_stored":53590105,"data_compressed":2758902,"data_compressed_allocated":26472448,"data_compressed_original":53436416,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26673152,"data_stored":53346304,"data_compressed":2753822,"data_compressed_allocated":26673152,"data_compressed_original":53346304,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28573696,"data_stored":57147392,"data_compressed":2950042,"data_compressed_allocated":28573696,"data_compressed_original":57147392,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32366592,"data_stored":64733184,"data_compressed":3341580,"data_compressed_allocated":32366592,"data_compressed_original":64733184,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28180480,"data_stored":56360960,"data_compressed":2909436,"data_compressed_allocated":28180480,"data_compressed_original":56360960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:31.345 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:31.391 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 70 16 12066 12050 1.34474 1.24219 0.0892715 0.0928526 2024-09-16T07:46:31.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:31.474+0000 7f0ac0f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:31.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:31.483+0000 7f0ac0f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:32.392 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 71 16 12232 12216 1.34407 1.29688 0.194357 0.0929296 2024-09-16T07:46:33.392 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 72 16 12369 12353 1.34026 1.07031 0.0645775 0.0931835 2024-09-16T07:46:33.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:33.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:33.977+0000 7f26cba7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:33.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:33.985+0000 7f26cba7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:34.392 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 73 16 12520 12504 1.33806 1.17969 0.192803 0.0933106 2024-09-16T07:46:35.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 74 16 12669 12653 1.33571 1.16406 0.0824373 0.0935127 2024-09-16T07:46:36.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:36.240 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:36.240 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:36.241 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:46:36.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:46:36.392 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 75 16 12829 12813 1.33457 1.25 0.0794511 0.0935594 2024-09-16T07:46:36.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:36.397+0000 7f083525c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:36.412+0000 7f083525c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:36.449+0000 7f6ffab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:36.465+0000 7f6ffab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:36.501 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:36.504 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:36.505 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:36.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:46:36.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:36.650+0000 7f7696911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:36.664+0000 7f7696911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:36.685 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:36.688 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:36.689 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:36.689 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:46:36.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:36.902+0000 7f580da46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:36.914+0000 7f580da46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:36.934 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:36.935 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:36.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:36.938 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:36.939 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:46:37.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:37.079+0000 7f33c0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:37.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:37.093+0000 7f33c0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:37.132 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:37.133 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:37.392 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 76 16 12994 12978 1.33397 1.28906 0.0838587 0.0936347 2024-09-16T07:46:38.392 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 77 16 13133 13117 1.33074 1.08594 0.125102 0.0938677 2024-09-16T07:46:38.653 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:38.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:38.785+0000 7f5768f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:38.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:38.794+0000 7f5768f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:39.392 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 78 16 13271 13255 1.3275 1.07812 0.0668194 0.0941138 2024-09-16T07:46:40.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 79 16 13432 13416 1.32662 1.25781 0.0937581 0.0941541 2024-09-16T07:46:40.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:41.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:41.118+0000 7ff7d8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:41.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:41.125+0000 7ff7d8391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:41.392 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:46:41.394389+0000 min lat: 0.0202414 max lat: 0.30697 avg lat: 0.0944039 2024-09-16T07:46:41.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:46:41.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 80 16 13562 13546 1.32273 1.01562 0.116094 0.0944039 2024-09-16T07:46:42.133 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:42.134 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:42.134 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:42.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:42.283+0000 7fddeb8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:42.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:42.296+0000 7fddeb8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:42.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 81 16 13716 13700 1.32125 1.20312 0.0838764 0.0945417 2024-09-16T07:46:42.585 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:46:42.586 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:46:42.606 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-09-16T07:46:41.777121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":77791795,"num_objects":1183,"num_object_clones":0,"num_object_copies":3549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":9505,"num_write_kb":76500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9479,"ondisk_log_size":9479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":400344,"kb_used_data":113944,"kb_used_omap":0,"kb_used_meta":286336,"kb_avail":377087016,"statfs":{"total":386547056640,"available":386137104384,"internally_reserved":0,"allocated":116678656,"data_stored":232202109,"data_compressed":11957007,"data_compressed_allocated":115064832,"data_compressed_original":231604224,"omap_allocated":0,"internal_metadata":293208064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002223"},"pg_stats":[{"pgid":"6.f","version":"45'592","reported_seq":604,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.739486+0000","last_change":"2024-09-16T07:45:20.518363+0000","last_active":"2024-09-16T07:46:13.739486+0000","last_peered":"2024-09-16T07:46:13.739486+0000","last_clean":"2024-09-16T07:46:13.739486+0000","last_became_active":"2024-09-16T07:45:20.511671+0000","last_became_peered":"2024-09-16T07:45:20.511671+0000","last_unstale":"2024-09-16T07:46:13.739486+0000","last_undegraded":"2024-09-16T07:46:13.739486+0000","last_fullsized":"2024-09-16T07:46:13.739486+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"45'648","reported_seq":660,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.015821+0000","last_change":"2024-09-16T07:45:20.429293+0000","last_active":"2024-09-16T07:46:14.015821+0000","last_peered":"2024-09-16T07:46:14.015821+0000","last_clean":"2024-09-16T07:46:14.015821+0000","last_became_active":"2024-09-16T07:45:20.417784+0000","last_became_peered":"2024-09-16T07:45:20.417784+0000","last_unstale":"2024-09-16T07:46:14.015821+0000","last_undegraded":"2024-09-16T07:46:14.015821+0000","last_fullsized":"2024-09-16T07:46:14.015821+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'688","reported_seq":700,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.666166+0000","last_change":"2024-09-16T07:45:20.434860+0000","last_active":"2024-09-16T07:46:13.666166+0000","last_peered":"2024-09-16T07:46:13.666166+0000","last_clean":"2024-09-16T07:46:13.666166+0000","last_became_active":"2024-09-16T07:45:20.424106+0000","last_became_peered":"2024-09-16T07:45:20.424106+0000","last_unstale":"2024-09-16T07:46:13.666166+0000","last_undegraded":"2024-09-16T07:46:13.666166+0000","last_fullsized":"2024-09-16T07:46:13.666166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"45'568","reported_seq":580,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.729052+0000","last_change":"2024-09-16T07:45:20.515551+0000","last_active":"2024-09-16T07:46:14.729052+0000","last_peered":"2024-09-16T07:46:14.729052+0000","last_clean":"2024-09-16T07:46:14.729052+0000","last_became_active":"2024-09-16T07:45:20.507157+0000","last_became_peered":"2024-09-16T07:45:20.507157+0000","last_unstale":"2024-09-16T07:46:14.729052+0000","last_undegraded":"2024-09-16T07:46:14.729052+0000","last_fullsized":"2024-09-16T07:46:14.729052+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"45'472","reported_seq":484,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:12.769900+0000","last_change":"2024-09-16T07:45:20.483112+0000","last_active":"2024-09-16T07:46:12.769900+0000","last_peered":"2024-09-16T07:46:12.769900+0000","last_clean":"2024-09-16T07:46:12.769900+0000","last_became_active":"2024-09-16T07:45:20.469905+0000","last_became_peered":"2024-09-16T07:45:20.469905+0000","last_unstale":"2024-09-16T07:46:12.769900+0000","last_undegraded":"2024-09-16T07:46:12.769900+0000","last_fullsized":"2024-09-16T07:46:12.769900+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"45'616","reported_seq":628,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.010425+0000","last_change":"2024-09-16T07:45:20.419879+0000","last_active":"2024-09-16T07:46:13.010425+0000","last_peered":"2024-09-16T07:46:13.010425+0000","last_clean":"2024-09-16T07:46:13.010425+0000","last_became_active":"2024-09-16T07:45:20.414183+0000","last_became_peered":"2024-09-16T07:45:20.414183+0000","last_unstale":"2024-09-16T07:46:13.010425+0000","last_undegraded":"2024-09-16T07:46:13.010425+0000","last_fullsized":"2024-09-16T07:46:13.010425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"45'568","reported_seq":580,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.213596+0000","last_change":"2024-09-16T07:45:20.421367+0000","last_active":"2024-09-16T07:46:13.213596+0000","last_peered":"2024-09-16T07:46:13.213596+0000","last_clean":"2024-09-16T07:46:13.213596+0000","last_became_active":"2024-09-16T07:45:20.411622+0000","last_became_peered":"2024-09-16T07:45:20.411622+0000","last_unstale":"2024-09-16T07:46:13.213596+0000","last_undegraded":"2024-09-16T07:46:13.213596+0000","last_fullsized":"2024-09-16T07:46:13.213596+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"45'752","reported_seq":764,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.505422+0000","last_change":"2024-09-16T07:45:20.441791+0000","last_active":"2024-09-16T07:46:14.505422+0000","last_peered":"2024-09-16T07:46:14.505422+0000","last_clean":"2024-09-16T07:46:14.505422+0000","last_became_active":"2024-09-16T07:45:20.430403+0000","last_became_peered":"2024-09-16T07:45:20.430403+0000","last_unstale":"2024-09-16T07:46:14.505422+0000","last_undegraded":"2024-09-16T07:46:14.505422+0000","last_fullsized":"2024-09-16T07:46:14.505422+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"45'626","reported_seq":638,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.739575+0000","last_change":"2024-09-16T07:45:20.448632+0000","last_active":"2024-09-16T07:46:14.739575+0000","last_peered":"2024-09-16T07:46:14.739575+0000","last_clean":"2024-09-16T07:46:14.739575+0000","last_became_active":"2024-09-16T07:45:20.436131+0000","last_became_peered":"2024-09-16T07:45:20.436131+0000","last_unstale":"2024-09-16T07:46:14.739575+0000","last_undegraded":"2024-09-16T07:46:14.739575+0000","last_fullsized":"2024-09-16T07:46:14.739575+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5128192,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":5008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"45'632","reported_seq":644,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.656331+0000","last_change":"2024-09-16T07:45:20.501623+0000","last_active":"2024-09-16T07:46:14.656331+0000","last_peered":"2024-09-16T07:46:14.656331+0000","last_clean":"2024-09-16T07:46:14.656331+0000","last_became_active":"2024-09-16T07:45:20.494483+0000","last_became_peered":"2024-09-16T07:45:20.494483+0000","last_unstale":"2024-09-16T07:46:14.656331+0000","last_undegraded":"2024-09-16T07:46:14.656331+0000","last_fullsized":"2024-09-16T07:46:14.656331+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5177344,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":632,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"45'416","reported_seq":428,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.602030+0000","last_change":"2024-09-16T07:45:20.478109+0000","last_active":"2024-09-16T07:46:14.602030+0000","last_peered":"2024-09-16T07:46:14.602030+0000","last_clean":"2024-09-16T07:46:14.602030+0000","last_became_active":"2024-09-16T07:45:20.471340+0000","last_became_peered":"2024-09-16T07:45:20.471340+0000","last_unstale":"2024-09-16T07:46:14.602030+0000","last_undegraded":"2024-09-16T07:46:14.602030+0000","last_fullsized":"2024-09-16T07:46:14.602030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"45'536","reported_seq":548,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.386607+0000","last_change":"2024-09-16T07:45:20.425615+0000","last_active":"2024-09-16T07:46:14.386607+0000","last_peered":"2024-09-16T07:46:14.386607+0000","last_clean":"2024-09-16T07:46:14.386607+0000","last_became_active":"2024-09-16T07:45:20.415753+0000","last_became_peered":"2024-09-16T07:45:20.415753+0000","last_unstale":"2024-09-16T07:46:14.386607+0000","last_undegraded":"2024-09-16T07:46:14.386607+0000","last_fullsized":"2024-09-16T07:46:14.386607+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"45'640","reported_seq":652,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.495686+0000","last_change":"2024-09-16T07:45:20.428249+0000","last_active":"2024-09-16T07:46:14.495686+0000","last_peered":"2024-09-16T07:46:14.495686+0000","last_clean":"2024-09-16T07:46:14.495686+0000","last_became_active":"2024-09-16T07:45:20.420592+0000","last_became_peered":"2024-09-16T07:45:20.420592+0000","last_unstale":"2024-09-16T07:46:14.495686+0000","last_undegraded":"2024-09-16T07:46:14.495686+0000","last_fullsized":"2024-09-16T07:46:14.495686+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"45'590","reported_seq":602,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.744850+0000","last_change":"2024-09-16T07:45:20.452728+0000","last_active":"2024-09-16T07:46:14.744850+0000","last_peered":"2024-09-16T07:46:14.744850+0000","last_clean":"2024-09-16T07:46:14.744850+0000","last_became_active":"2024-09-16T07:45:20.442417+0000","last_became_peered":"2024-09-16T07:45:20.442417+0000","last_unstale":"2024-09-16T07:46:14.744850+0000","last_undegraded":"2024-09-16T07:46:14.744850+0000","last_fullsized":"2024-09-16T07:46:14.744850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4833280,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":590,"num_write_kb":4720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"45'616","reported_seq":628,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:14.559973+0000","last_change":"2024-09-16T07:45:20.454595+0000","last_active":"2024-09-16T07:46:14.559973+0000","last_peered":"2024-09-16T07:46:14.559973+0000","last_clean":"2024-09-16T07:46:14.559973+0000","last_became_active":"2024-09-16T07:45:20.442809+0000","last_became_peered":"2024-09-16T07:45:20.442809+0000","last_unstale":"2024-09-16T07:46:14.559973+0000","last_undegraded":"2024-09-16T07:46:14.559973+0000","last_fullsized":"2024-09-16T07:46:14.559973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"45'464","reported_seq":476,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:13.382364+0000","last_change":"2024-09-16T07:45:20.460812+0000","last_active":"2024-09-16T07:46:13.382364+0000","last_peered":"2024-09-16T07:46:13.382364+0000","last_clean":"2024-09-16T07:46:13.382364+0000","last_became_active":"2024-09-16T07:45:20.448491+0000","last_became_peered":"2024-09-16T07:45:20.448491+0000","last_unstale":"2024-09-16T07:46:13.382364+0000","last_undegraded":"2024-09-16T07:46:13.382364+0000","last_fullsized":"2024-09-16T07:46:13.382364+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":77201408,"num_objects":1179,"num_object_clones":0,"num_object_copies":3537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9424,"num_write_kb":75392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":115793920,"data_stored":231587840,"data_compressed":11954880,"data_compressed_allocated":115793920,"data_compressed_original":231587840,"omap_allocated":0,"internal_metadata":0},"log_size":9424,"ondisk_log_size":9424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108660,"kb_used_data":27684,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94263180,"statfs":{"total":96636764160,"available":96525496320,"internally_reserved":0,"allocated":28348416,"data_stored":56055372,"data_compressed":2886594,"data_compressed_allocated":27959296,"data_compressed_original":55918592,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107276,"kb_used_data":31868,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94264564,"statfs":{"total":96636764160,"available":96526913536,"internally_reserved":0,"allocated":32632832,"data_stored":65091692,"data_compressed":3352582,"data_compressed_allocated":32223232,"data_compressed_original":64937984,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91072,"kb_used_data":28144,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94280768,"statfs":{"total":96636764160,"available":96543506432,"internally_reserved":0,"allocated":28819456,"data_stored":57464940,"data_compressed":2958929,"data_compressed_allocated":28409856,"data_compressed_original":57311232,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93336,"kb_used_data":26248,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94278504,"statfs":{"total":96636764160,"available":96541188096,"internally_reserved":0,"allocated":26877952,"data_stored":53590105,"data_compressed":2758902,"data_compressed_allocated":26472448,"data_compressed_original":53436416,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26673152,"data_stored":53346304,"data_compressed":2753822,"data_compressed_allocated":26673152,"data_compressed_original":53346304,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28573696,"data_stored":57147392,"data_compressed":2950042,"data_compressed_allocated":28573696,"data_compressed_original":57147392,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32366592,"data_stored":64733184,"data_compressed":3341580,"data_compressed_allocated":32366592,"data_compressed_original":64733184,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28180480,"data_stored":56360960,"data_compressed":2909436,"data_compressed_allocated":28180480,"data_compressed_original":56360960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:43.346 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:43.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 82 16 13863 13847 1.31914 1.14844 0.0565186 0.0947047 2024-09-16T07:46:43.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:43.495+0000 7f25a8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:43.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:43.504+0000 7f25a8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:44.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 83 16 14010 13994 1.31709 1.14844 0.181739 0.0947936 2024-09-16T07:46:45.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 84 16 14151 14135 1.31452 1.10156 0.161426 0.0949812 2024-09-16T07:46:45.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:45.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:45.945+0000 7efd7fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:45.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:45.954+0000 7efd7fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:46.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 85 16 14313 14297 1.31394 1.26562 0.186216 0.0950521 2024-09-16T07:46:47.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 86 16 14464 14448 1.31238 1.17969 0.107377 0.0951597 2024-09-16T07:46:47.608 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:47.608 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:47.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:46:47.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:47.740+0000 7f5e76751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:47.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:47.750+0000 7f5e76751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:47.977 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:46:47.977 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:46:47.995 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-16T07:46:47.778466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":115778099,"num_objects":1764,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14142,"num_write_kb":113596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14116,"ondisk_log_size":14116,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":517160,"kb_used_data":169704,"kb_used_omap":0,"kb_used_meta":347392,"kb_avail":376970200,"statfs":{"total":386547056640,"available":386017484800,"internally_reserved":0,"allocated":173776896,"data_stored":346398589,"data_compressed":17853624,"data_compressed_allocated":172163072,"data_compressed_original":345800704,"omap_allocated":0,"internal_metadata":355729408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":37986304,"num_objects":581,"num_object_clones":0,"num_object_copies":1743,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4637,"num_write_kb":37096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002513"},"pg_stats":[{"pgid":"6.f","version":"45'832","reported_seq":844,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.116400+0000","last_change":"2024-09-16T07:45:20.518363+0000","last_active":"2024-09-16T07:46:44.116400+0000","last_peered":"2024-09-16T07:46:44.116400+0000","last_clean":"2024-09-16T07:46:44.116400+0000","last_became_active":"2024-09-16T07:45:20.511671+0000","last_became_peered":"2024-09-16T07:45:20.511671+0000","last_unstale":"2024-09-16T07:46:44.116400+0000","last_undegraded":"2024-09-16T07:46:44.116400+0000","last_fullsized":"2024-09-16T07:46:44.116400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"45'944","reported_seq":956,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.677817+0000","last_change":"2024-09-16T07:45:20.429293+0000","last_active":"2024-09-16T07:46:44.677817+0000","last_peered":"2024-09-16T07:46:44.677817+0000","last_clean":"2024-09-16T07:46:44.677817+0000","last_became_active":"2024-09-16T07:45:20.417784+0000","last_became_peered":"2024-09-16T07:45:20.417784+0000","last_unstale":"2024-09-16T07:46:44.677817+0000","last_undegraded":"2024-09-16T07:46:44.677817+0000","last_fullsized":"2024-09-16T07:46:44.677817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'976","reported_seq":988,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.719452+0000","last_change":"2024-09-16T07:45:20.434860+0000","last_active":"2024-09-16T07:46:44.719452+0000","last_peered":"2024-09-16T07:46:44.719452+0000","last_clean":"2024-09-16T07:46:44.719452+0000","last_became_active":"2024-09-16T07:45:20.424106+0000","last_became_peered":"2024-09-16T07:45:20.424106+0000","last_unstale":"2024-09-16T07:46:44.719452+0000","last_undegraded":"2024-09-16T07:46:44.719452+0000","last_fullsized":"2024-09-16T07:46:44.719452+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"45'864","reported_seq":876,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.349000+0000","last_change":"2024-09-16T07:45:20.515551+0000","last_active":"2024-09-16T07:46:44.349000+0000","last_peered":"2024-09-16T07:46:44.349000+0000","last_clean":"2024-09-16T07:46:44.349000+0000","last_became_active":"2024-09-16T07:45:20.507157+0000","last_became_peered":"2024-09-16T07:45:20.507157+0000","last_unstale":"2024-09-16T07:46:44.349000+0000","last_undegraded":"2024-09-16T07:46:44.349000+0000","last_fullsized":"2024-09-16T07:46:44.349000+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"45'755","reported_seq":767,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.740850+0000","last_change":"2024-09-16T07:45:20.483112+0000","last_active":"2024-09-16T07:46:44.740850+0000","last_peered":"2024-09-16T07:46:44.740850+0000","last_clean":"2024-09-16T07:46:44.740850+0000","last_became_active":"2024-09-16T07:45:20.469905+0000","last_became_peered":"2024-09-16T07:45:20.469905+0000","last_unstale":"2024-09-16T07:46:44.740850+0000","last_undegraded":"2024-09-16T07:46:44.740850+0000","last_fullsized":"2024-09-16T07:46:44.740850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6184960,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":6040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"45'968","reported_seq":980,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.637509+0000","last_change":"2024-09-16T07:45:20.419879+0000","last_active":"2024-09-16T07:46:43.637509+0000","last_peered":"2024-09-16T07:46:43.637509+0000","last_clean":"2024-09-16T07:46:43.637509+0000","last_became_active":"2024-09-16T07:45:20.414183+0000","last_became_peered":"2024-09-16T07:45:20.414183+0000","last_unstale":"2024-09-16T07:46:43.637509+0000","last_undegraded":"2024-09-16T07:46:43.637509+0000","last_fullsized":"2024-09-16T07:46:43.637509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"45'888","reported_seq":900,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:42.827301+0000","last_change":"2024-09-16T07:45:20.421367+0000","last_active":"2024-09-16T07:46:42.827301+0000","last_peered":"2024-09-16T07:46:42.827301+0000","last_clean":"2024-09-16T07:46:42.827301+0000","last_became_active":"2024-09-16T07:45:20.411622+0000","last_became_peered":"2024-09-16T07:45:20.411622+0000","last_unstale":"2024-09-16T07:46:42.827301+0000","last_undegraded":"2024-09-16T07:46:42.827301+0000","last_fullsized":"2024-09-16T07:46:42.827301+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"45'1080","reported_seq":1092,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.473978+0000","last_change":"2024-09-16T07:45:20.441791+0000","last_active":"2024-09-16T07:46:44.473978+0000","last_peered":"2024-09-16T07:46:44.473978+0000","last_clean":"2024-09-16T07:46:44.473978+0000","last_became_active":"2024-09-16T07:45:20.430403+0000","last_became_peered":"2024-09-16T07:45:20.430403+0000","last_unstale":"2024-09-16T07:46:44.473978+0000","last_undegraded":"2024-09-16T07:46:44.473978+0000","last_fullsized":"2024-09-16T07:46:44.473978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"45'824","reported_seq":836,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.552783+0000","last_change":"2024-09-16T07:45:20.448632+0000","last_active":"2024-09-16T07:46:44.552783+0000","last_peered":"2024-09-16T07:46:44.552783+0000","last_clean":"2024-09-16T07:46:44.552783+0000","last_became_active":"2024-09-16T07:45:20.436131+0000","last_became_peered":"2024-09-16T07:45:20.436131+0000","last_unstale":"2024-09-16T07:46:44.552783+0000","last_undegraded":"2024-09-16T07:46:44.552783+0000","last_fullsized":"2024-09-16T07:46:44.552783+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"45'856","reported_seq":868,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.272026+0000","last_change":"2024-09-16T07:45:20.501623+0000","last_active":"2024-09-16T07:46:44.272026+0000","last_peered":"2024-09-16T07:46:44.272026+0000","last_clean":"2024-09-16T07:46:44.272026+0000","last_became_active":"2024-09-16T07:45:20.494483+0000","last_became_peered":"2024-09-16T07:45:20.494483+0000","last_unstale":"2024-09-16T07:46:44.272026+0000","last_undegraded":"2024-09-16T07:46:44.272026+0000","last_fullsized":"2024-09-16T07:46:44.272026+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"45'712","reported_seq":724,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.547388+0000","last_change":"2024-09-16T07:45:20.478109+0000","last_active":"2024-09-16T07:46:44.547388+0000","last_peered":"2024-09-16T07:46:44.547388+0000","last_clean":"2024-09-16T07:46:44.547388+0000","last_became_active":"2024-09-16T07:45:20.471340+0000","last_became_peered":"2024-09-16T07:45:20.471340+0000","last_unstale":"2024-09-16T07:46:44.547388+0000","last_undegraded":"2024-09-16T07:46:44.547388+0000","last_fullsized":"2024-09-16T07:46:44.547388+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"45'824","reported_seq":836,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.495641+0000","last_change":"2024-09-16T07:45:20.425615+0000","last_active":"2024-09-16T07:46:43.495641+0000","last_peered":"2024-09-16T07:46:43.495641+0000","last_clean":"2024-09-16T07:46:43.495641+0000","last_became_active":"2024-09-16T07:45:20.415753+0000","last_became_peered":"2024-09-16T07:45:20.415753+0000","last_unstale":"2024-09-16T07:46:43.495641+0000","last_undegraded":"2024-09-16T07:46:43.495641+0000","last_fullsized":"2024-09-16T07:46:43.495641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"45'961","reported_seq":973,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.767541+0000","last_change":"2024-09-16T07:45:20.428249+0000","last_active":"2024-09-16T07:46:43.767541+0000","last_peered":"2024-09-16T07:46:43.767541+0000","last_clean":"2024-09-16T07:46:43.767541+0000","last_became_active":"2024-09-16T07:45:20.420592+0000","last_became_peered":"2024-09-16T07:45:20.420592+0000","last_unstale":"2024-09-16T07:46:43.767541+0000","last_undegraded":"2024-09-16T07:46:43.767541+0000","last_fullsized":"2024-09-16T07:46:43.767541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872512,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":961,"num_write_kb":7688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"45'936","reported_seq":948,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.162521+0000","last_change":"2024-09-16T07:45:20.452728+0000","last_active":"2024-09-16T07:46:43.162521+0000","last_peered":"2024-09-16T07:46:43.162521+0000","last_clean":"2024-09-16T07:46:43.162521+0000","last_became_active":"2024-09-16T07:45:20.442417+0000","last_became_peered":"2024-09-16T07:45:20.442417+0000","last_unstale":"2024-09-16T07:46:43.162521+0000","last_undegraded":"2024-09-16T07:46:43.162521+0000","last_fullsized":"2024-09-16T07:46:43.162521+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"45'873","reported_seq":885,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.591770+0000","last_change":"2024-09-16T07:45:20.454595+0000","last_active":"2024-09-16T07:46:43.591770+0000","last_peered":"2024-09-16T07:46:43.591770+0000","last_clean":"2024-09-16T07:46:43.591770+0000","last_became_active":"2024-09-16T07:45:20.442809+0000","last_became_peered":"2024-09-16T07:45:20.442809+0000","last_unstale":"2024-09-16T07:46:43.591770+0000","last_undegraded":"2024-09-16T07:46:43.591770+0000","last_fullsized":"2024-09-16T07:46:43.591770+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7151616,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":6984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"45'768","reported_seq":780,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:42.366580+0000","last_change":"2024-09-16T07:45:20.460812+0000","last_active":"2024-09-16T07:46:42.366580+0000","last_peered":"2024-09-16T07:46:42.366580+0000","last_clean":"2024-09-16T07:46:42.366580+0000","last_became_active":"2024-09-16T07:45:20.448491+0000","last_became_peered":"2024-09-16T07:45:20.448491+0000","last_unstale":"2024-09-16T07:46:42.366580+0000","last_undegraded":"2024-09-16T07:46:42.366580+0000","last_fullsized":"2024-09-16T07:46:42.366580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":115187712,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14061,"num_write_kb":112488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172765184,"data_stored":345530368,"data_compressed":17838384,"data_compressed_allocated":172765184,"data_compressed_original":345530368,"omap_allocated":0,"internal_metadata":0},"log_size":14061,"ondisk_log_size":14061,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134964,"kb_used_data":41508,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94236876,"statfs":{"total":96636764160,"available":96498561024,"internally_reserved":0,"allocated":42504192,"data_stored":84366924,"data_compressed":4348482,"data_compressed_allocated":42115072,"data_compressed_original":84230144,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140308,"kb_used_data":46852,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94231532,"statfs":{"total":96636764160,"available":96493088768,"internally_reserved":0,"allocated":47976448,"data_stored":95778924,"data_compressed":4937139,"data_compressed_allocated":47566848,"data_compressed_original":95625216,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117132,"kb_used_data":41724,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94254708,"statfs":{"total":96636764160,"available":96516820992,"internally_reserved":0,"allocated":42725376,"data_stored":85276780,"data_compressed":4395013,"data_compressed_allocated":42315776,"data_compressed_original":85123072,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124756,"kb_used_data":39620,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94247084,"statfs":{"total":96636764160,"available":96509014016,"internally_reserved":0,"allocated":40570880,"data_stored":80975961,"data_compressed":4172990,"data_compressed_allocated":40165376,"data_compressed_original":80822272,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40374272,"data_stored":80748544,"data_compressed":4168756,"data_compressed_allocated":40374272,"data_compressed_original":80748544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42475520,"data_stored":84951040,"data_compressed":4385703,"data_compressed_allocated":42475520,"data_compressed_original":84951040,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47661056,"data_stored":95322112,"data_compressed":4921061,"data_compressed_allocated":47661056,"data_compressed_original":95322112,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42254336,"data_stored":84508672,"data_compressed":4362864,"data_compressed_allocated":42254336,"data_compressed_original":84508672,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:46:48.218 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:48.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:48.358+0000 7fd550b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:48.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:48.366+0000 7fd550b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:48.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 87 16 14606 14590 1.31005 1.10938 0.10435 0.0953656 2024-09-16T07:46:49.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 88 16 14755 14739 1.30839 1.16406 0.102984 0.0954848 2024-09-16T07:46:50.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 89 16 14900 14884 1.30641 1.13281 0.0991492 0.0955877 2024-09-16T07:46:50.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:51.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:51.030+0000 7fb241951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:51.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:51.040+0000 7fb241951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:51.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 90 15 15051 15036 1.30509 1.1875 0.150876 0.0956584 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total time run: 90.0295 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total writes made: 15051 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Write size: 8192 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object size: 65536 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Bandwidth (MB/sec): 1.30608 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Bandwidth: 0.130438 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max bandwidth (MB/sec): 1.60156 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min bandwidth (MB/sec): 1.01562 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average IOPS: 167 2024-09-16T07:46:52.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev IOPS: 16.6961 2024-09-16T07:46:52.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max IOPS: 205 2024-09-16T07:46:52.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min IOPS: 130 2024-09-16T07:46:52.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average Latency(s): 0.0956869 2024-09-16T07:46:52.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Latency(s): 0.0388259 2024-09-16T07:46:52.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max latency(s): 0.30697 2024-09-16T07:46:52.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min latency(s): 0.0202414 2024-09-16T07:46:52.425 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:46:52.997 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:52.997 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:52.997 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:46:52.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:46:53.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:53.156+0000 7ff484a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:53.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:53.170+0000 7ff484a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:53.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:53.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:53.470+0000 7ff300551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:53.483 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:53.483 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:53.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:46:53.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:53.485+0000 7ff2ff2ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:53.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:53.631+0000 7f12aa391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:53.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:53.648+0000 7f12aa391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:53.850 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:53.850 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:53.850 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:53.851 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:53.851 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:53.851 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:53.851 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:53.851 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:53.851 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:53.851 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:53.851 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:53.852 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:53.854 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:53.854 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:53.855 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:46:54.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:54.060+0000 7f4216391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:54.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:54.076+0000 7f4216391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:54.187 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:54.188 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:54.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:54.190 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:54.190 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:46:54.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:54.326+0000 7f6127391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:54.345+0000 7f6127391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:54.509 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:54.510 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:54.512 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:54.512 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:55.847 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:46:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:56.007+0000 7f2427f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:56.016+0000 7f2427f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:58.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:46:58.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:58.424+0000 7f7579f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:58.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:58.434+0000 7f7579f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:59.513 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:46:59.514 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:46:59.514 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:46:59.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:46:59.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:59.663+0000 7fe235b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:59.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:46:59.680+0000 7fe235b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:46:59.938 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:46:59.939 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:46:59.942 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:46:59.942 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:46:59.942 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:47:00.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:00.089+0000 7f0d692bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:00.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:00.104+0000 7f0d692bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:00.132 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:00.133 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:00.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:00.138 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:00.139 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:47:00.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:00.303+0000 7f0c88a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:00.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:00.318+0000 7f0c88a7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:00.388 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:00.388 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:00.388 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:00.388 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:00.392 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:00.393 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:00.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:47:00.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:00.538+0000 7fc335a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:00.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:00.555+0000 7fc335a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:00.729 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:00.729 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:00.730 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:00.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:00.734 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:00.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:01.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:01.036+0000 7f3e0f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:01.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:01.043+0000 7f3e0f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:02.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Removed 1882 objects 2024-09-16T07:47:02.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Clean up completed and total clean up time :10.0374 2024-09-16T07:47:03.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:03.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:03.457+0000 7f06250d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:03.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:03.462+0000 7f06250d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.048 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-09-16T07:47:05.048 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-09-16T07:47:05.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:05.162+0000 7f9b08191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:05.175+0000 7f9b08191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:05.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:05.668+0000 7f14bf391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:05.674+0000 7f14bf391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.735 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:05.735 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:05.735 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:05.842+0000 7f694f0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:05.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:05.849+0000 7f694f0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:06.033 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:47:06.034 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:47:06.046 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-09-16T07:47:05.782277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":115778099,"num_objects":1764,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14142,"num_write_kb":113596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14116,"ondisk_log_size":14116,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":517160,"kb_used_data":169704,"kb_used_omap":0,"kb_used_meta":347392,"kb_avail":376970200,"statfs":{"total":386547056640,"available":386017484800,"internally_reserved":0,"allocated":173776896,"data_stored":346398589,"data_compressed":17853624,"data_compressed_allocated":172163072,"data_compressed_original":345800704,"omap_allocated":0,"internal_metadata":355729408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002449"},"pg_stats":[{"pgid":"6.f","version":"45'832","reported_seq":844,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.116400+0000","last_change":"2024-09-16T07:45:20.518363+0000","last_active":"2024-09-16T07:46:44.116400+0000","last_peered":"2024-09-16T07:46:44.116400+0000","last_clean":"2024-09-16T07:46:44.116400+0000","last_became_active":"2024-09-16T07:45:20.511671+0000","last_became_peered":"2024-09-16T07:45:20.511671+0000","last_unstale":"2024-09-16T07:46:44.116400+0000","last_undegraded":"2024-09-16T07:46:44.116400+0000","last_fullsized":"2024-09-16T07:46:44.116400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"45'944","reported_seq":956,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.677817+0000","last_change":"2024-09-16T07:45:20.429293+0000","last_active":"2024-09-16T07:46:44.677817+0000","last_peered":"2024-09-16T07:46:44.677817+0000","last_clean":"2024-09-16T07:46:44.677817+0000","last_became_active":"2024-09-16T07:45:20.417784+0000","last_became_peered":"2024-09-16T07:45:20.417784+0000","last_unstale":"2024-09-16T07:46:44.677817+0000","last_undegraded":"2024-09-16T07:46:44.677817+0000","last_fullsized":"2024-09-16T07:46:44.677817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'976","reported_seq":988,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.719452+0000","last_change":"2024-09-16T07:45:20.434860+0000","last_active":"2024-09-16T07:46:44.719452+0000","last_peered":"2024-09-16T07:46:44.719452+0000","last_clean":"2024-09-16T07:46:44.719452+0000","last_became_active":"2024-09-16T07:45:20.424106+0000","last_became_peered":"2024-09-16T07:45:20.424106+0000","last_unstale":"2024-09-16T07:46:44.719452+0000","last_undegraded":"2024-09-16T07:46:44.719452+0000","last_fullsized":"2024-09-16T07:46:44.719452+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":976,"log_dups_size":0,"ondisk_log_size":976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"45'864","reported_seq":876,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.349000+0000","last_change":"2024-09-16T07:45:20.515551+0000","last_active":"2024-09-16T07:46:44.349000+0000","last_peered":"2024-09-16T07:46:44.349000+0000","last_clean":"2024-09-16T07:46:44.349000+0000","last_became_active":"2024-09-16T07:45:20.507157+0000","last_became_peered":"2024-09-16T07:45:20.507157+0000","last_unstale":"2024-09-16T07:46:44.349000+0000","last_undegraded":"2024-09-16T07:46:44.349000+0000","last_fullsized":"2024-09-16T07:46:44.349000+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"45'755","reported_seq":767,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.740850+0000","last_change":"2024-09-16T07:45:20.483112+0000","last_active":"2024-09-16T07:46:44.740850+0000","last_peered":"2024-09-16T07:46:44.740850+0000","last_clean":"2024-09-16T07:46:44.740850+0000","last_became_active":"2024-09-16T07:45:20.469905+0000","last_became_peered":"2024-09-16T07:45:20.469905+0000","last_unstale":"2024-09-16T07:46:44.740850+0000","last_undegraded":"2024-09-16T07:46:44.740850+0000","last_fullsized":"2024-09-16T07:46:44.740850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6184960,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":755,"num_write_kb":6040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"45'968","reported_seq":980,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.637509+0000","last_change":"2024-09-16T07:45:20.419879+0000","last_active":"2024-09-16T07:46:43.637509+0000","last_peered":"2024-09-16T07:46:43.637509+0000","last_clean":"2024-09-16T07:46:43.637509+0000","last_became_active":"2024-09-16T07:45:20.414183+0000","last_became_peered":"2024-09-16T07:45:20.414183+0000","last_unstale":"2024-09-16T07:46:43.637509+0000","last_undegraded":"2024-09-16T07:46:43.637509+0000","last_fullsized":"2024-09-16T07:46:43.637509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":968,"log_dups_size":0,"ondisk_log_size":968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"45'888","reported_seq":900,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:42.827301+0000","last_change":"2024-09-16T07:45:20.421367+0000","last_active":"2024-09-16T07:46:42.827301+0000","last_peered":"2024-09-16T07:46:42.827301+0000","last_clean":"2024-09-16T07:46:42.827301+0000","last_became_active":"2024-09-16T07:45:20.411622+0000","last_became_peered":"2024-09-16T07:45:20.411622+0000","last_unstale":"2024-09-16T07:46:42.827301+0000","last_undegraded":"2024-09-16T07:46:42.827301+0000","last_fullsized":"2024-09-16T07:46:42.827301+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"45'1080","reported_seq":1092,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.473978+0000","last_change":"2024-09-16T07:45:20.441791+0000","last_active":"2024-09-16T07:46:44.473978+0000","last_peered":"2024-09-16T07:46:44.473978+0000","last_clean":"2024-09-16T07:46:44.473978+0000","last_became_active":"2024-09-16T07:45:20.430403+0000","last_became_peered":"2024-09-16T07:45:20.430403+0000","last_unstale":"2024-09-16T07:46:44.473978+0000","last_undegraded":"2024-09-16T07:46:44.473978+0000","last_fullsized":"2024-09-16T07:46:44.473978+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":1080,"log_dups_size":0,"ondisk_log_size":1080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1080,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"45'824","reported_seq":836,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.552783+0000","last_change":"2024-09-16T07:45:20.448632+0000","last_active":"2024-09-16T07:46:44.552783+0000","last_peered":"2024-09-16T07:46:44.552783+0000","last_clean":"2024-09-16T07:46:44.552783+0000","last_became_active":"2024-09-16T07:45:20.436131+0000","last_became_peered":"2024-09-16T07:45:20.436131+0000","last_unstale":"2024-09-16T07:46:44.552783+0000","last_undegraded":"2024-09-16T07:46:44.552783+0000","last_fullsized":"2024-09-16T07:46:44.552783+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"45'856","reported_seq":868,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.272026+0000","last_change":"2024-09-16T07:45:20.501623+0000","last_active":"2024-09-16T07:46:44.272026+0000","last_peered":"2024-09-16T07:46:44.272026+0000","last_clean":"2024-09-16T07:46:44.272026+0000","last_became_active":"2024-09-16T07:45:20.494483+0000","last_became_peered":"2024-09-16T07:45:20.494483+0000","last_unstale":"2024-09-16T07:46:44.272026+0000","last_undegraded":"2024-09-16T07:46:44.272026+0000","last_fullsized":"2024-09-16T07:46:44.272026+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"45'712","reported_seq":724,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:44.547388+0000","last_change":"2024-09-16T07:45:20.478109+0000","last_active":"2024-09-16T07:46:44.547388+0000","last_peered":"2024-09-16T07:46:44.547388+0000","last_clean":"2024-09-16T07:46:44.547388+0000","last_became_active":"2024-09-16T07:45:20.471340+0000","last_became_peered":"2024-09-16T07:45:20.471340+0000","last_unstale":"2024-09-16T07:46:44.547388+0000","last_undegraded":"2024-09-16T07:46:44.547388+0000","last_fullsized":"2024-09-16T07:46:44.547388+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5832704,"num_objects":89,"num_object_clones":0,"num_object_copies":267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":5696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"45'824","reported_seq":836,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.495641+0000","last_change":"2024-09-16T07:45:20.425615+0000","last_active":"2024-09-16T07:46:43.495641+0000","last_peered":"2024-09-16T07:46:43.495641+0000","last_clean":"2024-09-16T07:46:43.495641+0000","last_became_active":"2024-09-16T07:45:20.415753+0000","last_became_peered":"2024-09-16T07:45:20.415753+0000","last_unstale":"2024-09-16T07:46:43.495641+0000","last_undegraded":"2024-09-16T07:46:43.495641+0000","last_fullsized":"2024-09-16T07:46:43.495641+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6750208,"num_objects":103,"num_object_clones":0,"num_object_copies":309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":6592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"45'961","reported_seq":973,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.767541+0000","last_change":"2024-09-16T07:45:20.428249+0000","last_active":"2024-09-16T07:46:43.767541+0000","last_peered":"2024-09-16T07:46:43.767541+0000","last_clean":"2024-09-16T07:46:43.767541+0000","last_became_active":"2024-09-16T07:45:20.420592+0000","last_became_peered":"2024-09-16T07:45:20.420592+0000","last_unstale":"2024-09-16T07:46:43.767541+0000","last_undegraded":"2024-09-16T07:46:43.767541+0000","last_fullsized":"2024-09-16T07:46:43.767541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7872512,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":961,"num_write_kb":7688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"45'936","reported_seq":948,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.162521+0000","last_change":"2024-09-16T07:45:20.452728+0000","last_active":"2024-09-16T07:46:43.162521+0000","last_peered":"2024-09-16T07:46:43.162521+0000","last_clean":"2024-09-16T07:46:43.162521+0000","last_became_active":"2024-09-16T07:45:20.442417+0000","last_became_peered":"2024-09-16T07:45:20.442417+0000","last_unstale":"2024-09-16T07:46:43.162521+0000","last_undegraded":"2024-09-16T07:46:43.162521+0000","last_fullsized":"2024-09-16T07:46:43.162521+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":936,"log_dups_size":0,"ondisk_log_size":936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2","version":"45'873","reported_seq":885,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:43.591770+0000","last_change":"2024-09-16T07:45:20.454595+0000","last_active":"2024-09-16T07:46:43.591770+0000","last_peered":"2024-09-16T07:46:43.591770+0000","last_clean":"2024-09-16T07:46:43.591770+0000","last_became_active":"2024-09-16T07:45:20.442809+0000","last_became_peered":"2024-09-16T07:45:20.442809+0000","last_unstale":"2024-09-16T07:46:43.591770+0000","last_undegraded":"2024-09-16T07:46:43.591770+0000","last_fullsized":"2024-09-16T07:46:43.591770+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7151616,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":6984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"45'768","reported_seq":780,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:46:42.366580+0000","last_change":"2024-09-16T07:45:20.460812+0000","last_active":"2024-09-16T07:46:42.366580+0000","last_peered":"2024-09-16T07:46:42.366580+0000","last_clean":"2024-09-16T07:46:42.366580+0000","last_became_active":"2024-09-16T07:45:20.448491+0000","last_became_peered":"2024-09-16T07:45:20.448491+0000","last_unstale":"2024-09-16T07:46:42.366580+0000","last_undegraded":"2024-09-16T07:46:42.366580+0000","last_fullsized":"2024-09-16T07:46:42.366580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:45:19.296546+0000","last_clean_scrub_stamp":"2024-09-16T07:45:19.296546+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":115187712,"num_objects":1760,"num_object_clones":0,"num_object_copies":5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14061,"num_write_kb":112488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172765184,"data_stored":345530368,"data_compressed":17838384,"data_compressed_allocated":172765184,"data_compressed_original":345530368,"omap_allocated":0,"internal_metadata":0},"log_size":14061,"ondisk_log_size":14061,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134964,"kb_used_data":41508,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94236876,"statfs":{"total":96636764160,"available":96498561024,"internally_reserved":0,"allocated":42504192,"data_stored":84366924,"data_compressed":4348482,"data_compressed_allocated":42115072,"data_compressed_original":84230144,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140308,"kb_used_data":46852,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94231532,"statfs":{"total":96636764160,"available":96493088768,"internally_reserved":0,"allocated":47976448,"data_stored":95778924,"data_compressed":4937139,"data_compressed_allocated":47566848,"data_compressed_original":95625216,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117132,"kb_used_data":41724,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94254708,"statfs":{"total":96636764160,"available":96516820992,"internally_reserved":0,"allocated":42725376,"data_stored":85276780,"data_compressed":4395013,"data_compressed_allocated":42315776,"data_compressed_original":85123072,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124756,"kb_used_data":39620,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94247084,"statfs":{"total":96636764160,"available":96509014016,"internally_reserved":0,"allocated":40570880,"data_stored":80975961,"data_compressed":4172990,"data_compressed_allocated":40165376,"data_compressed_original":80822272,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40374272,"data_stored":80748544,"data_compressed":4168756,"data_compressed_allocated":40374272,"data_compressed_original":80748544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":42475520,"data_stored":84951040,"data_compressed":4385703,"data_compressed_allocated":42475520,"data_compressed_original":84951040,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47661056,"data_stored":95322112,"data_compressed":4921061,"data_compressed_allocated":47661056,"data_compressed_original":95322112,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":42254336,"data_stored":84508672,"data_compressed":4362864,"data_compressed_allocated":42254336,"data_compressed_original":84508672,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:06.293 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_3' removed 2024-09-16T07:47:06.311 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:47:06.312 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:47:06.312 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-09-16T07:47:06.313 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-09-16T07:47:06.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:06.461+0000 7ffb8789c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:06.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:06.478+0000 7ffb8789c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:07.294 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_4' created 2024-09-16T07:47:07.316 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-09-16T07:47:07.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:07.452+0000 7fcf16111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:07.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:07.466+0000 7fcf16111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:07.774 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:07.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:07.881+0000 7fb719f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:07.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:07.886+0000 7fb719f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:08.303 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-09-16T07:47:09.326 DEBUG:teuthology.orchestra.run.smithi137:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-09-16T07:47:09.329 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:47:09.329 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:47:09.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:hints = 1 2024-09-16T07:47:09.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:47:09.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object prefix: benchmark_data_smithi137_48069 2024-09-16T07:47:09.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:47:09.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:47:09.984 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:10.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:10.111+0000 7fb4faa46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:10.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:10.121+0000 7fb4faa46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:10.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 1 16 199 183 1.42961 1.42969 0.1095 0.0825875 2024-09-16T07:47:11.049 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:11.049 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:11.049 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:11.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:11.206+0000 7f8512191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:11.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:11.223+0000 7f8512191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:11.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 2 16 391 375 1.46474 1.5 0.0484343 0.0831097 2024-09-16T07:47:11.526 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:47:11.527 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:47:11.551 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-16T07:47:09.783033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":517160,"kb_used_data":169704,"kb_used_omap":0,"kb_used_meta":347392,"kb_avail":376970200,"statfs":{"total":386547056640,"available":386017484800,"internally_reserved":0,"allocated":173776896,"data_stored":346398589,"data_compressed":17853624,"data_compressed_allocated":172163072,"data_compressed_original":345800704,"omap_allocated":0,"internal_metadata":355729408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-115187712,"num_objects":-1760,"num_object_clones":0,"num_object_copies":-5280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-14061,"num_write_kb":-112488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000756"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":178,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.315404+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:45:21.315404+0000","last_peered":"2024-09-16T07:45:21.315404+0000","last_clean":"2024-09-16T07:45:21.315404+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:45:21.315404+0000","last_undegraded":"2024-09-16T07:45:21.315404+0000","last_fullsized":"2024-09-16T07:45:21.315404+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320740+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:45:21.320740+0000","last_peered":"2024-09-16T07:45:21.320740+0000","last_clean":"2024-09-16T07:45:21.320740+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:45:21.320740+0000","last_undegraded":"2024-09-16T07:45:21.320740+0000","last_fullsized":"2024-09-16T07:45:21.320740+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314058+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:45:21.314058+0000","last_peered":"2024-09-16T07:45:21.314058+0000","last_clean":"2024-09-16T07:45:21.314058+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:45:21.314058+0000","last_undegraded":"2024-09-16T07:45:21.314058+0000","last_fullsized":"2024-09-16T07:45:21.314058+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320350+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:45:21.320350+0000","last_peered":"2024-09-16T07:45:21.320350+0000","last_clean":"2024-09-16T07:45:21.320350+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:45:21.320350+0000","last_undegraded":"2024-09-16T07:45:21.320350+0000","last_fullsized":"2024-09-16T07:45:21.320350+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":111,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.318027+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:45:21.318027+0000","last_peered":"2024-09-16T07:45:21.318027+0000","last_clean":"2024-09-16T07:45:21.318027+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:45:21.318027+0000","last_undegraded":"2024-09-16T07:45:21.318027+0000","last_fullsized":"2024-09-16T07:45:21.318027+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.320470+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:45:21.320470+0000","last_peered":"2024-09-16T07:45:21.320470+0000","last_clean":"2024-09-16T07:45:21.320470+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:45:21.320470+0000","last_undegraded":"2024-09-16T07:45:21.320470+0000","last_fullsized":"2024-09-16T07:45:21.320470+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.322665+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:45:21.322665+0000","last_peered":"2024-09-16T07:45:21.322665+0000","last_clean":"2024-09-16T07:45:21.322665+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:45:21.322665+0000","last_undegraded":"2024-09-16T07:45:21.322665+0000","last_fullsized":"2024-09-16T07:45:21.322665+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.312599+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:45:21.312599+0000","last_peered":"2024-09-16T07:45:21.312599+0000","last_clean":"2024-09-16T07:45:21.312599+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:45:21.312599+0000","last_undegraded":"2024-09-16T07:45:21.312599+0000","last_fullsized":"2024-09-16T07:45:21.312599+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:47:07.294401+0000","last_change":"2024-09-16T07:47:07.294401+0000","last_active":"2024-09-16T07:47:07.294401+0000","last_peered":"2024-09-16T07:47:07.294401+0000","last_clean":"2024-09-16T07:47:07.294401+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:47:07.294401+0000","last_undegraded":"2024-09-16T07:47:07.294401+0000","last_fullsized":"2024-09-16T07:47:07.294401+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-16T07:45:21.314669+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:45:21.314669+0000","last_peered":"2024-09-16T07:45:21.314669+0000","last_clean":"2024-09-16T07:45:21.314669+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:45:21.314669+0000","last_undegraded":"2024-09-16T07:45:21.314669+0000","last_fullsized":"2024-09-16T07:45:21.314669+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134964,"kb_used_data":41508,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94236876,"statfs":{"total":96636764160,"available":96498561024,"internally_reserved":0,"allocated":42504192,"data_stored":84366924,"data_compressed":4348482,"data_compressed_allocated":42115072,"data_compressed_original":84230144,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140308,"kb_used_data":46852,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94231532,"statfs":{"total":96636764160,"available":96493088768,"internally_reserved":0,"allocated":47976448,"data_stored":95778924,"data_compressed":4937139,"data_compressed_allocated":47566848,"data_compressed_original":95625216,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117132,"kb_used_data":41724,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94254708,"statfs":{"total":96636764160,"available":96516820992,"internally_reserved":0,"allocated":42725376,"data_stored":85276780,"data_compressed":4395013,"data_compressed_allocated":42315776,"data_compressed_original":85123072,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124756,"kb_used_data":39620,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94247084,"statfs":{"total":96636764160,"available":96509014016,"internally_reserved":0,"allocated":40570880,"data_stored":80975961,"data_compressed":4172990,"data_compressed_allocated":40165376,"data_compressed_original":80822272,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:12.331 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:12.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 3 16 572 556 1.4478 1.41406 0.0715273 0.0846802 2024-09-16T07:47:12.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:12.453+0000 7f873c457640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:12.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:12.465+0000 7f873c457640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:13.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 4 16 749 733 1.43149 1.38281 0.0491527 0.085448 2024-09-16T07:47:14.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 5 16 933 917 1.43267 1.4375 0.0486326 0.0865523 2024-09-16T07:47:14.868 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:15.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:15.022+0000 7f0782551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:15.029+0000 7f0782551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:15.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 6 16 1104 1088 1.41653 1.33594 0.0751423 0.0877796 2024-09-16T07:47:16.393 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 7 16 1298 1282 1.43067 1.51562 0.133469 0.0867563 2024-09-16T07:47:16.554 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:16.554 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:16.554 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:47:16.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:47:16.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:16.695+0000 7f2c7b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:16.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:16.707+0000 7f2c7b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:16.775 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:16.775 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:16.775 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:16.776 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:16.779 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:16.779 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:16.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:47:16.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:16.920+0000 7fd3a36ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:16.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:16.933+0000 7fd3a36ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:16.956 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:16.956 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:16.956 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:16.956 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:16.956 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:16.956 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:16.960 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:16.960 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:16.961 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:47:17.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:17.091+0000 7f40b3d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:17.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:17.102+0000 7f40b3d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:17.132 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:17.133 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:17.136 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:17.136 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:17.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:47:17.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:17.261+0000 7f020ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:17.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:17.279+0000 7f020ad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:17.301 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:17.301 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:17.301 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:17.301 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:17.301 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:17.301 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:17.301 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:17.301 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:17.302 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:17.302 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:17.302 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:17.302 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:17.305 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:17.305 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:17.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:17.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 8 16 1439 1423 1.38951 1.10156 0.0650226 0.0893863 2024-09-16T07:47:17.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:17.474+0000 7f858cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:17.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:17.484+0000 7f858cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:18.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 9 16 1643 1627 1.41219 1.59375 0.0832118 0.0881393 2024-09-16T07:47:19.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 10 16 1833 1817 1.41939 1.48438 0.0853835 0.0879277 2024-09-16T07:47:19.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:20.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:20.049+0000 7f21d9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:20.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:20.060+0000 7f21d9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:20.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 11 16 1998 1982 1.40753 1.28906 0.181314 0.08821 2024-09-16T07:47:21.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 12 16 2176 2160 1.40611 1.39062 0.0922912 0.0885723 2024-09-16T07:47:22.306 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:22.307 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:22.307 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:47:22.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:47:22.322 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:22.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 13 16 2350 2334 1.4025 1.35938 0.150663 0.0887639 2024-09-16T07:47:22.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:22.449+0000 7f5257751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:22.463+0000 7f5257751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:22.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:22.510+0000 7ff4a9488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:22.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:22.520+0000 7ff4a9488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:22.635 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:22.636 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:22.638 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:22.638 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:22.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:47:22.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:22.771+0000 7f7e6e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:22.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:22.781+0000 7f7e6e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:22.796 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:22.797 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:22.799 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:22.799 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:22.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:47:22.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:22.933+0000 7f1dc5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:22.945+0000 7f1dc5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:22.977 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:22.978 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:22.978 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:22.978 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:22.981 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:22.981 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:22.982 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:47:23.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:23.147+0000 7f8a7bf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:23.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:23.159+0000 7f8a7bf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:23.183 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:23.183 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:23.184 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:23.187 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:23.188 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:23.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 14 16 2509 2493 1.39105 1.24219 0.160541 0.0892993 2024-09-16T07:47:24.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 15 16 2657 2641 1.37539 1.15625 0.0745431 0.0905745 2024-09-16T07:47:24.839 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:25.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:25.013+0000 7f6457cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:25.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:25.022+0000 7f6457cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:25.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 16 16 2833 2817 1.37536 1.375 0.0739591 0.0906214 2024-09-16T07:47:26.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 17 16 3035 3019 1.38728 1.57812 0.109795 0.0899265 2024-09-16T07:47:27.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:27.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:27.370+0000 7f3447511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:27.380+0000 7f3447511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:27.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 18 16 3197 3181 1.38051 1.26562 0.0843984 0.0902382 2024-09-16T07:47:28.188 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:28.188 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:28.189 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:47:28.189 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:47:28.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:28.325+0000 7f1536991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:28.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:28.338+0000 7f1536991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:28.378 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:28.379 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:28.379 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:28.381 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:28.382 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:28.382 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:47:28.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 19 16 3369 3353 1.37857 1.34375 0.155482 0.09036 2024-09-16T07:47:28.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:28.537+0000 7f51f2493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:28.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:28.548+0000 7f51f2493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:28.579 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:28.580 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:28.582 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:28.583 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:28.583 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:47:28.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:28.755+0000 7fb37ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:28.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:28.769+0000 7fb37ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:28.952 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:28.953 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:28.955 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:28.955 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:28.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:47:29.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:29.098+0000 7f8032c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:29.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:29.115+0000 7f8032c7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:29.177 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:29.177 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:29.178 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:29.181 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:29.182 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:29.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:47:29.396435+0000 min lat: 0.0161532 max lat: 0.23857 avg lat: 0.0907538 2024-09-16T07:47:29.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:47:29.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 20 16 3534 3518 1.37409 1.28906 0.0625143 0.0907538 2024-09-16T07:47:29.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:29.875+0000 7fb89b8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:29.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:29.881+0000 7fb89b8bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:30.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 21 16 3698 3682 1.36966 1.28125 0.0684593 0.0910945 2024-09-16T07:47:31.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 22 16 3857 3841 1.36386 1.24219 0.196411 0.0912547 2024-09-16T07:47:32.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:32.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:32.241+0000 7f5751591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:32.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:32.248+0000 7f5751591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:32.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 23 16 4013 3997 1.35755 1.21875 0.0743813 0.0918363 2024-09-16T07:47:33.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 24 16 4200 4184 1.36185 1.46094 0.0725174 0.0915863 2024-09-16T07:47:34.183 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:34.184 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:34.184 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:47:34.184 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:47:34.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:34.341+0000 7ff6d3d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:34.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:34.353+0000 7ff6d3d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:34.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 25 16 4356 4340 1.35612 1.21875 0.0479636 0.092054 2024-09-16T07:47:34.399 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:34.399 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:34.399 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:34.399 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:34.400 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:34.400 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:34.400 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:34.400 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:34.400 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:34.400 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:34.400 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:34.400 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:34.403 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:34.403 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:34.404 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:47:34.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:34.551+0000 7f37c9ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:34.564+0000 7f37c9ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:34.593 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:34.667 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:34.667 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:34.667 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:34.667 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:34.668 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:34.671 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:34.672 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:34.672 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:47:34.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:34.763+0000 7f4d7db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:34.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:34.776+0000 7f4d7db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:34.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:34.835+0000 7fb18d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:34.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:34.852+0000 7fb18d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:34.932 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:34.932 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:34.932 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:34.932 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:34.932 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:34.932 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:34.933 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:34.933 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:34.933 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:34.933 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:34.933 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:34.933 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:34.937 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:34.937 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:34.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:47:35.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:35.118+0000 7fbda3a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:35.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:35.129+0000 7fbda3a88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:35.199 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:35.203 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:35.203 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:35.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 26 16 4533 4517 1.35715 1.38281 0.0361985 0.0918312 2024-09-16T07:47:36.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 27 16 4710 4694 1.35809 1.38281 0.0687216 0.0919221 2024-09-16T07:47:37.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:37.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:37.163+0000 7faf7e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:37.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:37.170+0000 7faf7e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:37.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 28 16 4889 4873 1.35953 1.39844 0.0904358 0.0917222 2024-09-16T07:47:38.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 29 16 5058 5042 1.35817 1.32031 0.0717404 0.0919021 2024-09-16T07:47:39.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 30 16 5210 5194 1.35248 1.1875 0.219733 0.0921699 2024-09-16T07:47:39.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:39.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:39.581+0000 7fac7eebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:39.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:39.588+0000 7fac7eebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:40.205 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:40.205 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:40.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:40.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:40.366+0000 7f96ffb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:40.380+0000 7f96ffb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:40.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 31 16 5387 5371 1.35345 1.38281 0.102215 0.0922232 2024-09-16T07:47:40.660 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:47:40.661 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:47:40.677 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-16T07:47:39.788697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8602163,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":1059,"num_write_kb":8932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1033,"ondisk_log_size":1033,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":374332,"kb_used_data":12988,"kb_used_omap":0,"kb_used_meta":361280,"kb_avail":377113028,"statfs":{"total":386547056640,"available":386163740672,"internally_reserved":0,"allocated":13299712,"data_stored":25205737,"data_compressed":1265895,"data_compressed_allocated":11538432,"data_compressed_original":24551424,"omap_allocated":0,"internal_metadata":369950720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002160"},"pg_stats":[{"pgid":"7.f","version":"49'96","reported_seq":108,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.490571+0000","last_change":"2024-09-16T07:47:08.477709+0000","last_active":"2024-09-16T07:47:14.490571+0000","last_peered":"2024-09-16T07:47:14.490571+0000","last_clean":"2024-09-16T07:47:14.490571+0000","last_became_active":"2024-09-16T07:47:08.464812+0000","last_became_peered":"2024-09-16T07:47:08.464812+0000","last_unstale":"2024-09-16T07:47:14.490571+0000","last_undegraded":"2024-09-16T07:47:14.490571+0000","last_fullsized":"2024-09-16T07:47:14.490571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"49'56","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.306075+0000","last_change":"2024-09-16T07:47:08.422056+0000","last_active":"2024-09-16T07:47:14.306075+0000","last_peered":"2024-09-16T07:47:14.306075+0000","last_clean":"2024-09-16T07:47:14.306075+0000","last_became_active":"2024-09-16T07:47:08.410012+0000","last_became_peered":"2024-09-16T07:47:08.410012+0000","last_unstale":"2024-09-16T07:47:14.306075+0000","last_undegraded":"2024-09-16T07:47:14.306075+0000","last_fullsized":"2024-09-16T07:47:14.306075+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"49'56","reported_seq":68,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.393369+0000","last_change":"2024-09-16T07:47:08.481315+0000","last_active":"2024-09-16T07:47:14.393369+0000","last_peered":"2024-09-16T07:47:14.393369+0000","last_clean":"2024-09-16T07:47:14.393369+0000","last_became_active":"2024-09-16T07:47:08.470559+0000","last_became_peered":"2024-09-16T07:47:08.470559+0000","last_unstale":"2024-09-16T07:47:14.393369+0000","last_undegraded":"2024-09-16T07:47:14.393369+0000","last_fullsized":"2024-09-16T07:47:14.393369+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"49'58","reported_seq":70,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.752758+0000","last_change":"2024-09-16T07:47:08.443238+0000","last_active":"2024-09-16T07:47:14.752758+0000","last_peered":"2024-09-16T07:47:14.752758+0000","last_clean":"2024-09-16T07:47:14.752758+0000","last_became_active":"2024-09-16T07:47:08.433242+0000","last_became_peered":"2024-09-16T07:47:08.433242+0000","last_unstale":"2024-09-16T07:47:14.752758+0000","last_undegraded":"2024-09-16T07:47:14.752758+0000","last_fullsized":"2024-09-16T07:47:14.752758+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":475136,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"49'48","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.688052+0000","last_change":"2024-09-16T07:47:08.440399+0000","last_active":"2024-09-16T07:47:14.688052+0000","last_peered":"2024-09-16T07:47:14.688052+0000","last_clean":"2024-09-16T07:47:14.688052+0000","last_became_active":"2024-09-16T07:47:08.432293+0000","last_became_peered":"2024-09-16T07:47:08.432293+0000","last_unstale":"2024-09-16T07:47:14.688052+0000","last_undegraded":"2024-09-16T07:47:14.688052+0000","last_fullsized":"2024-09-16T07:47:14.688052+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"49'64","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.113025+0000","last_change":"2024-09-16T07:47:08.475491+0000","last_active":"2024-09-16T07:47:14.113025+0000","last_peered":"2024-09-16T07:47:14.113025+0000","last_clean":"2024-09-16T07:47:14.113025+0000","last_became_active":"2024-09-16T07:47:08.458228+0000","last_became_peered":"2024-09-16T07:47:08.458228+0000","last_unstale":"2024-09-16T07:47:14.113025+0000","last_undegraded":"2024-09-16T07:47:14.113025+0000","last_fullsized":"2024-09-16T07:47:14.113025+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"49'48","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.240829+0000","last_change":"2024-09-16T07:47:08.483381+0000","last_active":"2024-09-16T07:47:14.240829+0000","last_peered":"2024-09-16T07:47:14.240829+0000","last_clean":"2024-09-16T07:47:14.240829+0000","last_became_active":"2024-09-16T07:47:08.474048+0000","last_became_peered":"2024-09-16T07:47:08.474048+0000","last_unstale":"2024-09-16T07:47:14.240829+0000","last_undegraded":"2024-09-16T07:47:14.240829+0000","last_fullsized":"2024-09-16T07:47:14.240829+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"49'80","reported_seq":92,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.434533+0000","last_change":"2024-09-16T07:47:08.466199+0000","last_active":"2024-09-16T07:47:14.434533+0000","last_peered":"2024-09-16T07:47:14.434533+0000","last_clean":"2024-09-16T07:47:14.434533+0000","last_became_active":"2024-09-16T07:47:08.458169+0000","last_became_peered":"2024-09-16T07:47:08.458169+0000","last_unstale":"2024-09-16T07:47:14.434533+0000","last_undegraded":"2024-09-16T07:47:14.434533+0000","last_fullsized":"2024-09-16T07:47:14.434533+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"49'80","reported_seq":92,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.727807+0000","last_change":"2024-09-16T07:47:08.522521+0000","last_active":"2024-09-16T07:47:14.727807+0000","last_peered":"2024-09-16T07:47:14.727807+0000","last_clean":"2024-09-16T07:47:14.727807+0000","last_became_active":"2024-09-16T07:47:08.512943+0000","last_became_peered":"2024-09-16T07:47:08.512943+0000","last_unstale":"2024-09-16T07:47:14.727807+0000","last_undegraded":"2024-09-16T07:47:14.727807+0000","last_fullsized":"2024-09-16T07:47:14.727807+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320092+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:47:09.320092+0000","last_peered":"2024-09-16T07:47:09.320092+0000","last_clean":"2024-09-16T07:47:09.320092+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:47:09.320092+0000","last_undegraded":"2024-09-16T07:47:09.320092+0000","last_fullsized":"2024-09-16T07:47:09.320092+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":122,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.329039+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:47:09.329039+0000","last_peered":"2024-09-16T07:47:09.329039+0000","last_clean":"2024-09-16T07:47:09.329039+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:47:09.329039+0000","last_undegraded":"2024-09-16T07:47:09.329039+0000","last_fullsized":"2024-09-16T07:47:09.329039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"49'80","reported_seq":92,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:13.373085+0000","last_change":"2024-09-16T07:47:08.461993+0000","last_active":"2024-09-16T07:47:13.373085+0000","last_peered":"2024-09-16T07:47:13.373085+0000","last_clean":"2024-09-16T07:47:13.373085+0000","last_became_active":"2024-09-16T07:47:08.450836+0000","last_became_peered":"2024-09-16T07:47:08.450836+0000","last_unstale":"2024-09-16T07:47:13.373085+0000","last_undegraded":"2024-09-16T07:47:13.373085+0000","last_fullsized":"2024-09-16T07:47:13.373085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320986+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:47:09.320986+0000","last_peered":"2024-09-16T07:47:09.320986+0000","last_clean":"2024-09-16T07:47:09.320986+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:47:09.320986+0000","last_undegraded":"2024-09-16T07:47:09.320986+0000","last_fullsized":"2024-09-16T07:47:09.320986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"49'104","reported_seq":116,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.391571+0000","last_change":"2024-09-16T07:47:08.517634+0000","last_active":"2024-09-16T07:47:14.391571+0000","last_peered":"2024-09-16T07:47:14.391571+0000","last_clean":"2024-09-16T07:47:14.391571+0000","last_became_active":"2024-09-16T07:47:08.504996+0000","last_became_peered":"2024-09-16T07:47:08.504996+0000","last_unstale":"2024-09-16T07:47:14.391571+0000","last_undegraded":"2024-09-16T07:47:14.391571+0000","last_fullsized":"2024-09-16T07:47:14.391571+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":851968,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.328134+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:47:09.328134+0000","last_peered":"2024-09-16T07:47:09.328134+0000","last_clean":"2024-09-16T07:47:09.328134+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:47:09.328134+0000","last_undegraded":"2024-09-16T07:47:09.328134+0000","last_fullsized":"2024-09-16T07:47:09.328134+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"49'48","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.238977+0000","last_change":"2024-09-16T07:47:08.460081+0000","last_active":"2024-09-16T07:47:14.238977+0000","last_peered":"2024-09-16T07:47:14.238977+0000","last_clean":"2024-09-16T07:47:14.238977+0000","last_became_active":"2024-09-16T07:47:08.449752+0000","last_became_peered":"2024-09-16T07:47:08.449752+0000","last_unstale":"2024-09-16T07:47:14.238977+0000","last_undegraded":"2024-09-16T07:47:14.238977+0000","last_fullsized":"2024-09-16T07:47:14.238977+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":123,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326852+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:47:09.326852+0000","last_peered":"2024-09-16T07:47:09.326852+0000","last_clean":"2024-09-16T07:47:09.326852+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:47:09.326852+0000","last_undegraded":"2024-09-16T07:47:09.326852+0000","last_fullsized":"2024-09-16T07:47:09.326852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"49'64","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:13.949741+0000","last_change":"2024-09-16T07:47:08.437239+0000","last_active":"2024-09-16T07:47:13.949741+0000","last_peered":"2024-09-16T07:47:13.949741+0000","last_clean":"2024-09-16T07:47:13.949741+0000","last_became_active":"2024-09-16T07:47:08.428482+0000","last_became_peered":"2024-09-16T07:47:08.428482+0000","last_unstale":"2024-09-16T07:47:13.949741+0000","last_undegraded":"2024-09-16T07:47:13.949741+0000","last_fullsized":"2024-09-16T07:47:13.949741+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.330235+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:47:09.330235+0000","last_peered":"2024-09-16T07:47:09.330235+0000","last_clean":"2024-09-16T07:47:09.330235+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:47:09.330235+0000","last_undegraded":"2024-09-16T07:47:09.330235+0000","last_fullsized":"2024-09-16T07:47:09.330235+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"49'48","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:14.580677+0000","last_change":"2024-09-16T07:47:08.420660+0000","last_active":"2024-09-16T07:47:14.580677+0000","last_peered":"2024-09-16T07:47:14.580677+0000","last_clean":"2024-09-16T07:47:14.580677+0000","last_became_active":"2024-09-16T07:47:08.412209+0000","last_became_peered":"2024-09-16T07:47:08.412209+0000","last_unstale":"2024-09-16T07:47:14.580677+0000","last_undegraded":"2024-09-16T07:47:14.580677+0000","last_fullsized":"2024-09-16T07:47:14.580677+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326073+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:47:09.326073+0000","last_peered":"2024-09-16T07:47:09.326073+0000","last_clean":"2024-09-16T07:47:09.326073+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:47:09.326073+0000","last_undegraded":"2024-09-16T07:47:09.326073+0000","last_fullsized":"2024-09-16T07:47:09.326073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"49'16","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:13.703469+0000","last_change":"2024-09-16T07:47:08.467569+0000","last_active":"2024-09-16T07:47:13.703469+0000","last_peered":"2024-09-16T07:47:13.703469+0000","last_clean":"2024-09-16T07:47:13.703469+0000","last_became_active":"2024-09-16T07:47:08.454580+0000","last_became_peered":"2024-09-16T07:47:08.454580+0000","last_unstale":"2024-09-16T07:47:13.703469+0000","last_undegraded":"2024-09-16T07:47:13.703469+0000","last_fullsized":"2024-09-16T07:47:13.703469+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131072,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.321147+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:47:09.321147+0000","last_peered":"2024-09-16T07:47:09.321147+0000","last_clean":"2024-09-16T07:47:09.321147+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:47:09.321147+0000","last_undegraded":"2024-09-16T07:47:09.321147+0000","last_fullsized":"2024-09-16T07:47:09.321147+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"49'32","reported_seq":44,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:11.109941+0000","last_change":"2024-09-16T07:47:08.508888+0000","last_active":"2024-09-16T07:47:11.109941+0000","last_peered":"2024-09-16T07:47:11.109941+0000","last_clean":"2024-09-16T07:47:11.109941+0000","last_became_active":"2024-09-16T07:47:08.500244+0000","last_became_peered":"2024-09-16T07:47:08.500244+0000","last_unstale":"2024-09-16T07:47:11.109941+0000","last_undegraded":"2024-09-16T07:47:11.109941+0000","last_fullsized":"2024-09-16T07:47:11.109941+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320068+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:47:09.320068+0000","last_peered":"2024-09-16T07:47:09.320068+0000","last_clean":"2024-09-16T07:47:09.320068+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:47:09.320068+0000","last_undegraded":"2024-09-16T07:47:09.320068+0000","last_fullsized":"2024-09-16T07:47:09.320068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":8011776,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":7824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12013568,"data_stored":24027136,"data_compressed":1237396,"data_compressed_allocated":12013568,"data_compressed_original":24027136,"omap_allocated":0,"internal_metadata":0},"log_size":978,"ondisk_log_size":978,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92792,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94279048,"statfs":{"total":96636764160,"available":96541745152,"internally_reserved":0,"allocated":3579904,"data_stored":6458727,"data_compressed":324838,"data_compressed_allocated":3153920,"data_compressed_original":6307840,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92332,"kb_used_data":3036,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94279508,"statfs":{"total":96636764160,"available":96542216192,"internally_reserved":0,"allocated":3108864,"data_stored":5984135,"data_compressed":300069,"data_compressed_allocated":2662400,"data_compressed_original":5816320,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91828,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94280012,"statfs":{"total":96636764160,"available":96542732288,"internally_reserved":0,"allocated":2592768,"data_stored":4951943,"data_compressed":246875,"data_compressed_allocated":2146304,"data_compressed_original":4784128,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":97380,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94274460,"statfs":{"total":96636764160,"available":96537047040,"internally_reserved":0,"allocated":4018176,"data_stored":7810932,"data_compressed":394113,"data_compressed_allocated":3575808,"data_compressed_original":7643136,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3780608,"data_stored":7561216,"data_compressed":389396,"data_compressed_allocated":3780608,"data_compressed_original":7561216,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2228224,"data_stored":4456448,"data_compressed":229498,"data_compressed_allocated":2228224,"data_compressed_original":4456448,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2686976,"data_stored":5373952,"data_compressed":276784,"data_compressed_allocated":2686976,"data_compressed_original":5373952,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3317760,"data_stored":6635520,"data_compressed":341718,"data_compressed_allocated":3317760,"data_compressed_original":6635520,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:41.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 32 16 5542 5526 1.349 1.21094 0.044979 0.0925207 2024-09-16T07:47:41.879 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:42.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:42.022+0000 7fbbc8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:42.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:42.030+0000 7fbbc8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:42.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 33 16 5721 5705 1.35049 1.39844 0.0988913 0.0924381 2024-09-16T07:47:43.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 34 16 5891 5875 1.34983 1.32812 0.140241 0.0924453 2024-09-16T07:47:44.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:44.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 35 16 6053 6037 1.34742 1.26562 0.118654 0.0925651 2024-09-16T07:47:44.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:44.486+0000 7fc8582bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:44.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:44.493+0000 7fc8582bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:45.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 36 16 6201 6185 1.34211 1.15625 0.108789 0.0929719 2024-09-16T07:47:45.679 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:45.680 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:45.680 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:47:45.680 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:47:45.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:45.819+0000 7fe6ff391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:45.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:45.836+0000 7fe6ff391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.009 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:46.009 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:46.009 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:46.009 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:46.009 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:46.010 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:46.010 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:46.010 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:46.010 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:46.010 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:46.010 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:46.010 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:46.013 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:46.014 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:46.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:47:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:46.155+0000 7fa6e0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:46.171+0000 7fa6e0991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.207 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:46.208 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:46.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:46.211 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:46.211 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:47:46.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:46.368+0000 7f27ff511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:46.388+0000 7f27ff511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 37 16 6380 6364 1.34363 1.39844 0.102079 0.092909 2024-09-16T07:47:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:46.435 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:46.435 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:46.435 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:46.435 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:46.438 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:46.438 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:46.439 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:47:46.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:46.591+0000 7fb07fcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:46.604+0000 7fb07fcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.697 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:46.697 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:46.700 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:46.701 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:46.835 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:46.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:46.981+0000 7f2a67191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:46.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:46.990+0000 7f2a67191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:47.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 38 16 6547 6531 1.3426 1.30469 0.122139 0.0929712 2024-09-16T07:47:48.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 39 16 6693 6677 1.33742 1.14062 0.103191 0.0932712 2024-09-16T07:47:49.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:47:49.398183+0000 min lat: 0.0161532 max lat: 0.249185 avg lat: 0.0932906 2024-09-16T07:47:49.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:47:49.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 40 16 6866 6850 1.33777 1.35156 0.103363 0.0932906 2024-09-16T07:47:49.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:49.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:49.549+0000 7fdff9a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:49.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:49.558+0000 7fdff9a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:50.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 41 16 7037 7021 1.33772 1.33594 0.068096 0.093332 2024-09-16T07:47:51.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 42 16 7220 7204 1.33991 1.42969 0.0288703 0.0931787 2024-09-16T07:47:51.701 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:51.702 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:51.702 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:47:51.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:47:51.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:51.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:51.830+0000 7f3fe4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:51.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:51.847+0000 7f3fe4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:51.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:51.942+0000 7fecec49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:51.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:51.950+0000 7fecec49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:52.025 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:52.026 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:52.026 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:52.026 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:52.026 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:52.028 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:52.029 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:52.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:47:52.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:52.180+0000 7f2163391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:52.194+0000 7f2163391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.305 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:52.305 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:52.305 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:52.305 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:52.305 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:52.305 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:52.305 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:52.308 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:52.309 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:52.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:47:52.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 43 16 7356 7340 1.33346 1.0625 0.0772211 0.0936666 2024-09-16T07:47:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:52.490+0000 7f3e7aafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:52.503+0000 7f3e7aafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:52.542 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:52.542 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:52.542 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:52.545 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:52.546 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:52.546 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:47:52.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:52.689+0000 7f8a70b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:52.707+0000 7f8a70b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:52.739 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:47:52.740 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:47:52.744 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:47:52.745 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:47:53.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 44 16 7513 7497 1.33102 1.22656 0.117556 0.0937463 2024-09-16T07:47:54.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:54.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 45 16 7686 7670 1.33148 1.35156 0.127908 0.0937192 2024-09-16T07:47:54.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:54.445+0000 7f7a2844f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:54.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:54.451+0000 7f7a2844f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:55.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 46 16 7852 7836 1.33072 1.29688 0.0834989 0.0937467 2024-09-16T07:47:56.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 47 16 8030 8014 1.33199 1.39062 0.127503 0.0936921 2024-09-16T07:47:56.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:47:57.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:57.125+0000 7f953a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:57.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:57.133+0000 7f953a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:57.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 48 16 8187 8171 1.3298 1.22656 0.0530905 0.0939249 2024-09-16T07:47:57.746 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:47:57.747 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:47:57.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:47:57.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:57.883+0000 7fc2f1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:57.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:57.893+0000 7fc2f1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:58.144 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:47:58.144 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:47:58.158 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-16T07:47:57.792196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50528819,"num_objects":767,"num_object_clones":0,"num_object_copies":2301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6177,"num_write_kb":49876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6151,"ondisk_log_size":6151,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":423368,"kb_used_data":74504,"kb_used_omap":0,"kb_used_meta":348800,"kb_avail":377063992,"statfs":{"total":386547056640,"available":386113527808,"internally_reserved":0,"allocated":76292096,"data_stored":151190505,"data_compressed":7770999,"data_compressed_allocated":74530816,"data_compressed_original":150536192,"omap_allocated":0,"internal_metadata":357171200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002434"},"pg_stats":[{"pgid":"7.f","version":"49'424","reported_seq":436,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.548131+0000","last_change":"2024-09-16T07:47:08.477709+0000","last_active":"2024-09-16T07:47:44.548131+0000","last_peered":"2024-09-16T07:47:44.548131+0000","last_clean":"2024-09-16T07:47:44.548131+0000","last_became_active":"2024-09-16T07:47:08.464812+0000","last_became_peered":"2024-09-16T07:47:08.464812+0000","last_unstale":"2024-09-16T07:47:44.548131+0000","last_undegraded":"2024-09-16T07:47:44.548131+0000","last_fullsized":"2024-09-16T07:47:44.548131+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"49'496","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.465557+0000","last_change":"2024-09-16T07:47:08.422056+0000","last_active":"2024-09-16T07:47:44.465557+0000","last_peered":"2024-09-16T07:47:44.465557+0000","last_clean":"2024-09-16T07:47:44.465557+0000","last_became_active":"2024-09-16T07:47:08.410012+0000","last_became_peered":"2024-09-16T07:47:08.410012+0000","last_unstale":"2024-09-16T07:47:44.465557+0000","last_undegraded":"2024-09-16T07:47:44.465557+0000","last_fullsized":"2024-09-16T07:47:44.465557+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"49'348","reported_seq":360,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.746397+0000","last_change":"2024-09-16T07:47:08.481315+0000","last_active":"2024-09-16T07:47:44.746397+0000","last_peered":"2024-09-16T07:47:44.746397+0000","last_clean":"2024-09-16T07:47:44.746397+0000","last_became_active":"2024-09-16T07:47:08.470559+0000","last_became_peered":"2024-09-16T07:47:08.470559+0000","last_unstale":"2024-09-16T07:47:44.746397+0000","last_undegraded":"2024-09-16T07:47:44.746397+0000","last_fullsized":"2024-09-16T07:47:44.746397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2850816,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.496624+0000","last_change":"2024-09-16T07:47:08.443238+0000","last_active":"2024-09-16T07:47:44.496624+0000","last_peered":"2024-09-16T07:47:44.496624+0000","last_clean":"2024-09-16T07:47:44.496624+0000","last_became_active":"2024-09-16T07:47:08.433242+0000","last_became_peered":"2024-09-16T07:47:08.433242+0000","last_unstale":"2024-09-16T07:47:44.496624+0000","last_undegraded":"2024-09-16T07:47:44.496624+0000","last_fullsized":"2024-09-16T07:47:44.496624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"49'376","reported_seq":388,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.688235+0000","last_change":"2024-09-16T07:47:08.440399+0000","last_active":"2024-09-16T07:47:44.688235+0000","last_peered":"2024-09-16T07:47:44.688235+0000","last_clean":"2024-09-16T07:47:44.688235+0000","last_became_active":"2024-09-16T07:47:08.432293+0000","last_became_peered":"2024-09-16T07:47:08.432293+0000","last_unstale":"2024-09-16T07:47:44.688235+0000","last_undegraded":"2024-09-16T07:47:44.688235+0000","last_fullsized":"2024-09-16T07:47:44.688235+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"49'328","reported_seq":340,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.576070+0000","last_change":"2024-09-16T07:47:08.475491+0000","last_active":"2024-09-16T07:47:43.576070+0000","last_peered":"2024-09-16T07:47:43.576070+0000","last_clean":"2024-09-16T07:47:43.576070+0000","last_became_active":"2024-09-16T07:47:08.458228+0000","last_became_peered":"2024-09-16T07:47:08.458228+0000","last_unstale":"2024-09-16T07:47:43.576070+0000","last_undegraded":"2024-09-16T07:47:43.576070+0000","last_fullsized":"2024-09-16T07:47:43.576070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"49'332","reported_seq":344,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.750765+0000","last_change":"2024-09-16T07:47:08.483381+0000","last_active":"2024-09-16T07:47:44.750765+0000","last_peered":"2024-09-16T07:47:44.750765+0000","last_clean":"2024-09-16T07:47:44.750765+0000","last_became_active":"2024-09-16T07:47:08.474048+0000","last_became_peered":"2024-09-16T07:47:08.474048+0000","last_unstale":"2024-09-16T07:47:44.750765+0000","last_undegraded":"2024-09-16T07:47:44.750765+0000","last_fullsized":"2024-09-16T07:47:44.750765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2719744,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"49'312","reported_seq":324,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.662222+0000","last_change":"2024-09-16T07:47:08.466199+0000","last_active":"2024-09-16T07:47:42.662222+0000","last_peered":"2024-09-16T07:47:42.662222+0000","last_clean":"2024-09-16T07:47:42.662222+0000","last_became_active":"2024-09-16T07:47:08.458169+0000","last_became_peered":"2024-09-16T07:47:08.458169+0000","last_unstale":"2024-09-16T07:47:42.662222+0000","last_undegraded":"2024-09-16T07:47:42.662222+0000","last_fullsized":"2024-09-16T07:47:42.662222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"49'432","reported_seq":444,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.926046+0000","last_change":"2024-09-16T07:47:08.522521+0000","last_active":"2024-09-16T07:47:43.926046+0000","last_peered":"2024-09-16T07:47:43.926046+0000","last_clean":"2024-09-16T07:47:43.926046+0000","last_became_active":"2024-09-16T07:47:08.512943+0000","last_became_peered":"2024-09-16T07:47:08.512943+0000","last_unstale":"2024-09-16T07:47:43.926046+0000","last_undegraded":"2024-09-16T07:47:43.926046+0000","last_fullsized":"2024-09-16T07:47:43.926046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320092+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:47:09.320092+0000","last_peered":"2024-09-16T07:47:09.320092+0000","last_clean":"2024-09-16T07:47:09.320092+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:47:09.320092+0000","last_undegraded":"2024-09-16T07:47:09.320092+0000","last_fullsized":"2024-09-16T07:47:09.320092+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":122,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.329039+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:47:09.329039+0000","last_peered":"2024-09-16T07:47:09.329039+0000","last_clean":"2024-09-16T07:47:09.329039+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:47:09.329039+0000","last_undegraded":"2024-09-16T07:47:09.329039+0000","last_fullsized":"2024-09-16T07:47:09.329039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.985641+0000","last_change":"2024-09-16T07:47:08.461993+0000","last_active":"2024-09-16T07:47:43.985641+0000","last_peered":"2024-09-16T07:47:43.985641+0000","last_clean":"2024-09-16T07:47:43.985641+0000","last_became_active":"2024-09-16T07:47:08.450836+0000","last_became_peered":"2024-09-16T07:47:08.450836+0000","last_unstale":"2024-09-16T07:47:43.985641+0000","last_undegraded":"2024-09-16T07:47:43.985641+0000","last_fullsized":"2024-09-16T07:47:43.985641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320986+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:47:09.320986+0000","last_peered":"2024-09-16T07:47:09.320986+0000","last_clean":"2024-09-16T07:47:09.320986+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:47:09.320986+0000","last_undegraded":"2024-09-16T07:47:09.320986+0000","last_fullsized":"2024-09-16T07:47:09.320986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"49'360","reported_seq":372,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.922962+0000","last_change":"2024-09-16T07:47:08.517634+0000","last_active":"2024-09-16T07:47:42.922962+0000","last_peered":"2024-09-16T07:47:42.922962+0000","last_clean":"2024-09-16T07:47:42.922962+0000","last_became_active":"2024-09-16T07:47:08.504996+0000","last_became_peered":"2024-09-16T07:47:08.504996+0000","last_unstale":"2024-09-16T07:47:42.922962+0000","last_undegraded":"2024-09-16T07:47:42.922962+0000","last_fullsized":"2024-09-16T07:47:42.922962+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.328134+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:47:09.328134+0000","last_peered":"2024-09-16T07:47:09.328134+0000","last_clean":"2024-09-16T07:47:09.328134+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:47:09.328134+0000","last_undegraded":"2024-09-16T07:47:09.328134+0000","last_fullsized":"2024-09-16T07:47:09.328134+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"49'408","reported_seq":420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.545243+0000","last_change":"2024-09-16T07:47:08.460081+0000","last_active":"2024-09-16T07:47:42.545243+0000","last_peered":"2024-09-16T07:47:42.545243+0000","last_clean":"2024-09-16T07:47:42.545243+0000","last_became_active":"2024-09-16T07:47:08.449752+0000","last_became_peered":"2024-09-16T07:47:08.449752+0000","last_unstale":"2024-09-16T07:47:42.545243+0000","last_undegraded":"2024-09-16T07:47:42.545243+0000","last_fullsized":"2024-09-16T07:47:42.545243+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":123,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326852+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:47:09.326852+0000","last_peered":"2024-09-16T07:47:09.326852+0000","last_clean":"2024-09-16T07:47:09.326852+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:47:09.326852+0000","last_undegraded":"2024-09-16T07:47:09.326852+0000","last_fullsized":"2024-09-16T07:47:09.326852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"49'416","reported_seq":428,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.384650+0000","last_change":"2024-09-16T07:47:08.437239+0000","last_active":"2024-09-16T07:47:44.384650+0000","last_peered":"2024-09-16T07:47:44.384650+0000","last_clean":"2024-09-16T07:47:44.384650+0000","last_became_active":"2024-09-16T07:47:08.428482+0000","last_became_peered":"2024-09-16T07:47:08.428482+0000","last_unstale":"2024-09-16T07:47:44.384650+0000","last_undegraded":"2024-09-16T07:47:44.384650+0000","last_fullsized":"2024-09-16T07:47:44.384650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.330235+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:47:09.330235+0000","last_peered":"2024-09-16T07:47:09.330235+0000","last_clean":"2024-09-16T07:47:09.330235+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:47:09.330235+0000","last_undegraded":"2024-09-16T07:47:09.330235+0000","last_fullsized":"2024-09-16T07:47:09.330235+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.448369+0000","last_change":"2024-09-16T07:47:08.420660+0000","last_active":"2024-09-16T07:47:44.448369+0000","last_peered":"2024-09-16T07:47:44.448369+0000","last_clean":"2024-09-16T07:47:44.448369+0000","last_became_active":"2024-09-16T07:47:08.412209+0000","last_became_peered":"2024-09-16T07:47:08.412209+0000","last_unstale":"2024-09-16T07:47:44.448369+0000","last_undegraded":"2024-09-16T07:47:44.448369+0000","last_fullsized":"2024-09-16T07:47:44.448369+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326073+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:47:09.326073+0000","last_peered":"2024-09-16T07:47:09.326073+0000","last_clean":"2024-09-16T07:47:09.326073+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:47:09.326073+0000","last_undegraded":"2024-09-16T07:47:09.326073+0000","last_fullsized":"2024-09-16T07:47:09.326073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"49'280","reported_seq":292,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.244481+0000","last_change":"2024-09-16T07:47:08.467569+0000","last_active":"2024-09-16T07:47:44.244481+0000","last_peered":"2024-09-16T07:47:44.244481+0000","last_clean":"2024-09-16T07:47:44.244481+0000","last_became_active":"2024-09-16T07:47:08.454580+0000","last_became_peered":"2024-09-16T07:47:08.454580+0000","last_unstale":"2024-09-16T07:47:44.244481+0000","last_undegraded":"2024-09-16T07:47:44.244481+0000","last_fullsized":"2024-09-16T07:47:44.244481+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.321147+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:47:09.321147+0000","last_peered":"2024-09-16T07:47:09.321147+0000","last_clean":"2024-09-16T07:47:09.321147+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:47:09.321147+0000","last_undegraded":"2024-09-16T07:47:09.321147+0000","last_fullsized":"2024-09-16T07:47:09.321147+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"49'432","reported_seq":444,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.817601+0000","last_change":"2024-09-16T07:47:08.508888+0000","last_active":"2024-09-16T07:47:42.817601+0000","last_peered":"2024-09-16T07:47:42.817601+0000","last_clean":"2024-09-16T07:47:42.817601+0000","last_became_active":"2024-09-16T07:47:08.500244+0000","last_became_peered":"2024-09-16T07:47:08.500244+0000","last_unstale":"2024-09-16T07:47:42.817601+0000","last_undegraded":"2024-09-16T07:47:42.817601+0000","last_fullsized":"2024-09-16T07:47:42.817601+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320068+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:47:09.320068+0000","last_peered":"2024-09-16T07:47:09.320068+0000","last_clean":"2024-09-16T07:47:09.320068+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:47:09.320068+0000","last_undegraded":"2024-09-16T07:47:09.320068+0000","last_fullsized":"2024-09-16T07:47:09.320068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":49938432,"num_objects":763,"num_object_clones":0,"num_object_copies":2289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6096,"num_write_kb":48768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74907648,"data_stored":149815296,"data_compressed":7732494,"data_compressed_allocated":74907648,"data_compressed_original":149815296,"omap_allocated":0,"internal_metadata":0},"log_size":6096,"ondisk_log_size":6096,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114060,"kb_used_data":20604,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94257780,"statfs":{"total":96636764160,"available":96519966720,"internally_reserved":0,"allocated":21098496,"data_stored":41495911,"data_compressed":2133947,"data_compressed_allocated":20672512,"data_compressed_original":41345024,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106656,"kb_used_data":17360,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94265184,"statfs":{"total":96636764160,"available":96527548416,"internally_reserved":0,"allocated":17776640,"data_stored":35319687,"data_compressed":1814808,"data_compressed_allocated":17330176,"data_compressed_original":35151872,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98972,"kb_used_data":13836,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94272868,"statfs":{"total":96636764160,"available":96535416832,"internally_reserved":0,"allocated":14168064,"data_stored":28102535,"data_compressed":1442227,"data_compressed_allocated":13721600,"data_compressed_original":27934720,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103680,"kb_used_data":22704,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94268160,"statfs":{"total":96636764160,"available":96530595840,"internally_reserved":0,"allocated":23248896,"data_stored":46272372,"data_compressed":2380017,"data_compressed_allocated":22806528,"data_compressed_original":46104576,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22937600,"data_stored":45875200,"data_compressed":2367746,"data_compressed_allocated":22937600,"data_compressed_original":45875200,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13848576,"data_stored":27697152,"data_compressed":1429533,"data_compressed_allocated":13848576,"data_compressed_original":27697152,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17313792,"data_stored":34627584,"data_compressed":1787309,"data_compressed_allocated":17313792,"data_compressed_original":34627584,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20807680,"data_stored":41615360,"data_compressed":2147906,"data_compressed_allocated":20807680,"data_compressed_original":41615360,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:47:58.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 49 16 8358 8342 1.32992 1.33594 0.055478 0.09389 2024-09-16T07:47:59.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 50 16 8530 8514 1.33019 1.34375 0.090433 0.0938063 2024-09-16T07:47:59.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:47:59.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:59.690+0000 7fef53b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:47:59.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:47:59.700+0000 7fef53b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:00.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 51 16 8688 8672 1.32831 1.23438 0.0772495 0.0940028 2024-09-16T07:48:01.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 52 16 8850 8834 1.3271 1.26562 0.0888079 0.0940998 2024-09-16T07:48:01.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:02.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:02.038+0000 7fa05dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:02.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:02.045+0000 7fa05dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:02.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 53 16 9007 8991 1.3252 1.22656 0.0506592 0.0942187 2024-09-16T07:48:03.160 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:03.160 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:03.161 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:03.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:03.315+0000 7fdd106a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:03.326+0000 7fdd106a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:03.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 54 16 9164 9148 1.32338 1.22656 0.0911314 0.0943489 2024-09-16T07:48:03.631 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:48:03.632 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:48:03.646 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-16T07:48:01.792941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50528819,"num_objects":767,"num_object_clones":0,"num_object_copies":2301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6177,"num_write_kb":49876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6151,"ondisk_log_size":6151,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":423368,"kb_used_data":74504,"kb_used_omap":0,"kb_used_meta":348800,"kb_avail":377063992,"statfs":{"total":386547056640,"available":386113527808,"internally_reserved":0,"allocated":76292096,"data_stored":151190505,"data_compressed":7770999,"data_compressed_allocated":74530816,"data_compressed_original":150536192,"omap_allocated":0,"internal_metadata":357171200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002335"},"pg_stats":[{"pgid":"7.f","version":"49'424","reported_seq":436,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.548131+0000","last_change":"2024-09-16T07:47:08.477709+0000","last_active":"2024-09-16T07:47:44.548131+0000","last_peered":"2024-09-16T07:47:44.548131+0000","last_clean":"2024-09-16T07:47:44.548131+0000","last_became_active":"2024-09-16T07:47:08.464812+0000","last_became_peered":"2024-09-16T07:47:08.464812+0000","last_unstale":"2024-09-16T07:47:44.548131+0000","last_undegraded":"2024-09-16T07:47:44.548131+0000","last_fullsized":"2024-09-16T07:47:44.548131+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"49'496","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.465557+0000","last_change":"2024-09-16T07:47:08.422056+0000","last_active":"2024-09-16T07:47:44.465557+0000","last_peered":"2024-09-16T07:47:44.465557+0000","last_clean":"2024-09-16T07:47:44.465557+0000","last_became_active":"2024-09-16T07:47:08.410012+0000","last_became_peered":"2024-09-16T07:47:08.410012+0000","last_unstale":"2024-09-16T07:47:44.465557+0000","last_undegraded":"2024-09-16T07:47:44.465557+0000","last_fullsized":"2024-09-16T07:47:44.465557+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"49'348","reported_seq":360,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.746397+0000","last_change":"2024-09-16T07:47:08.481315+0000","last_active":"2024-09-16T07:47:44.746397+0000","last_peered":"2024-09-16T07:47:44.746397+0000","last_clean":"2024-09-16T07:47:44.746397+0000","last_became_active":"2024-09-16T07:47:08.470559+0000","last_became_peered":"2024-09-16T07:47:08.470559+0000","last_unstale":"2024-09-16T07:47:44.746397+0000","last_undegraded":"2024-09-16T07:47:44.746397+0000","last_fullsized":"2024-09-16T07:47:44.746397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2850816,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.496624+0000","last_change":"2024-09-16T07:47:08.443238+0000","last_active":"2024-09-16T07:47:44.496624+0000","last_peered":"2024-09-16T07:47:44.496624+0000","last_clean":"2024-09-16T07:47:44.496624+0000","last_became_active":"2024-09-16T07:47:08.433242+0000","last_became_peered":"2024-09-16T07:47:08.433242+0000","last_unstale":"2024-09-16T07:47:44.496624+0000","last_undegraded":"2024-09-16T07:47:44.496624+0000","last_fullsized":"2024-09-16T07:47:44.496624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"49'376","reported_seq":388,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.688235+0000","last_change":"2024-09-16T07:47:08.440399+0000","last_active":"2024-09-16T07:47:44.688235+0000","last_peered":"2024-09-16T07:47:44.688235+0000","last_clean":"2024-09-16T07:47:44.688235+0000","last_became_active":"2024-09-16T07:47:08.432293+0000","last_became_peered":"2024-09-16T07:47:08.432293+0000","last_unstale":"2024-09-16T07:47:44.688235+0000","last_undegraded":"2024-09-16T07:47:44.688235+0000","last_fullsized":"2024-09-16T07:47:44.688235+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"49'328","reported_seq":340,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.576070+0000","last_change":"2024-09-16T07:47:08.475491+0000","last_active":"2024-09-16T07:47:43.576070+0000","last_peered":"2024-09-16T07:47:43.576070+0000","last_clean":"2024-09-16T07:47:43.576070+0000","last_became_active":"2024-09-16T07:47:08.458228+0000","last_became_peered":"2024-09-16T07:47:08.458228+0000","last_unstale":"2024-09-16T07:47:43.576070+0000","last_undegraded":"2024-09-16T07:47:43.576070+0000","last_fullsized":"2024-09-16T07:47:43.576070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"49'332","reported_seq":344,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.750765+0000","last_change":"2024-09-16T07:47:08.483381+0000","last_active":"2024-09-16T07:47:44.750765+0000","last_peered":"2024-09-16T07:47:44.750765+0000","last_clean":"2024-09-16T07:47:44.750765+0000","last_became_active":"2024-09-16T07:47:08.474048+0000","last_became_peered":"2024-09-16T07:47:08.474048+0000","last_unstale":"2024-09-16T07:47:44.750765+0000","last_undegraded":"2024-09-16T07:47:44.750765+0000","last_fullsized":"2024-09-16T07:47:44.750765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2719744,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"49'312","reported_seq":324,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.662222+0000","last_change":"2024-09-16T07:47:08.466199+0000","last_active":"2024-09-16T07:47:42.662222+0000","last_peered":"2024-09-16T07:47:42.662222+0000","last_clean":"2024-09-16T07:47:42.662222+0000","last_became_active":"2024-09-16T07:47:08.458169+0000","last_became_peered":"2024-09-16T07:47:08.458169+0000","last_unstale":"2024-09-16T07:47:42.662222+0000","last_undegraded":"2024-09-16T07:47:42.662222+0000","last_fullsized":"2024-09-16T07:47:42.662222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"49'432","reported_seq":444,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.926046+0000","last_change":"2024-09-16T07:47:08.522521+0000","last_active":"2024-09-16T07:47:43.926046+0000","last_peered":"2024-09-16T07:47:43.926046+0000","last_clean":"2024-09-16T07:47:43.926046+0000","last_became_active":"2024-09-16T07:47:08.512943+0000","last_became_peered":"2024-09-16T07:47:08.512943+0000","last_unstale":"2024-09-16T07:47:43.926046+0000","last_undegraded":"2024-09-16T07:47:43.926046+0000","last_fullsized":"2024-09-16T07:47:43.926046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320092+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:47:09.320092+0000","last_peered":"2024-09-16T07:47:09.320092+0000","last_clean":"2024-09-16T07:47:09.320092+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:47:09.320092+0000","last_undegraded":"2024-09-16T07:47:09.320092+0000","last_fullsized":"2024-09-16T07:47:09.320092+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":122,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.329039+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:47:09.329039+0000","last_peered":"2024-09-16T07:47:09.329039+0000","last_clean":"2024-09-16T07:47:09.329039+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:47:09.329039+0000","last_undegraded":"2024-09-16T07:47:09.329039+0000","last_fullsized":"2024-09-16T07:47:09.329039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.985641+0000","last_change":"2024-09-16T07:47:08.461993+0000","last_active":"2024-09-16T07:47:43.985641+0000","last_peered":"2024-09-16T07:47:43.985641+0000","last_clean":"2024-09-16T07:47:43.985641+0000","last_became_active":"2024-09-16T07:47:08.450836+0000","last_became_peered":"2024-09-16T07:47:08.450836+0000","last_unstale":"2024-09-16T07:47:43.985641+0000","last_undegraded":"2024-09-16T07:47:43.985641+0000","last_fullsized":"2024-09-16T07:47:43.985641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320986+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:47:09.320986+0000","last_peered":"2024-09-16T07:47:09.320986+0000","last_clean":"2024-09-16T07:47:09.320986+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:47:09.320986+0000","last_undegraded":"2024-09-16T07:47:09.320986+0000","last_fullsized":"2024-09-16T07:47:09.320986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"49'360","reported_seq":372,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.922962+0000","last_change":"2024-09-16T07:47:08.517634+0000","last_active":"2024-09-16T07:47:42.922962+0000","last_peered":"2024-09-16T07:47:42.922962+0000","last_clean":"2024-09-16T07:47:42.922962+0000","last_became_active":"2024-09-16T07:47:08.504996+0000","last_became_peered":"2024-09-16T07:47:08.504996+0000","last_unstale":"2024-09-16T07:47:42.922962+0000","last_undegraded":"2024-09-16T07:47:42.922962+0000","last_fullsized":"2024-09-16T07:47:42.922962+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.328134+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:47:09.328134+0000","last_peered":"2024-09-16T07:47:09.328134+0000","last_clean":"2024-09-16T07:47:09.328134+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:47:09.328134+0000","last_undegraded":"2024-09-16T07:47:09.328134+0000","last_fullsized":"2024-09-16T07:47:09.328134+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"49'408","reported_seq":420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.545243+0000","last_change":"2024-09-16T07:47:08.460081+0000","last_active":"2024-09-16T07:47:42.545243+0000","last_peered":"2024-09-16T07:47:42.545243+0000","last_clean":"2024-09-16T07:47:42.545243+0000","last_became_active":"2024-09-16T07:47:08.449752+0000","last_became_peered":"2024-09-16T07:47:08.449752+0000","last_unstale":"2024-09-16T07:47:42.545243+0000","last_undegraded":"2024-09-16T07:47:42.545243+0000","last_fullsized":"2024-09-16T07:47:42.545243+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":123,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326852+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:47:09.326852+0000","last_peered":"2024-09-16T07:47:09.326852+0000","last_clean":"2024-09-16T07:47:09.326852+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:47:09.326852+0000","last_undegraded":"2024-09-16T07:47:09.326852+0000","last_fullsized":"2024-09-16T07:47:09.326852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"49'416","reported_seq":428,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.384650+0000","last_change":"2024-09-16T07:47:08.437239+0000","last_active":"2024-09-16T07:47:44.384650+0000","last_peered":"2024-09-16T07:47:44.384650+0000","last_clean":"2024-09-16T07:47:44.384650+0000","last_became_active":"2024-09-16T07:47:08.428482+0000","last_became_peered":"2024-09-16T07:47:08.428482+0000","last_unstale":"2024-09-16T07:47:44.384650+0000","last_undegraded":"2024-09-16T07:47:44.384650+0000","last_fullsized":"2024-09-16T07:47:44.384650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.330235+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:47:09.330235+0000","last_peered":"2024-09-16T07:47:09.330235+0000","last_clean":"2024-09-16T07:47:09.330235+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:47:09.330235+0000","last_undegraded":"2024-09-16T07:47:09.330235+0000","last_fullsized":"2024-09-16T07:47:09.330235+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.448369+0000","last_change":"2024-09-16T07:47:08.420660+0000","last_active":"2024-09-16T07:47:44.448369+0000","last_peered":"2024-09-16T07:47:44.448369+0000","last_clean":"2024-09-16T07:47:44.448369+0000","last_became_active":"2024-09-16T07:47:08.412209+0000","last_became_peered":"2024-09-16T07:47:08.412209+0000","last_unstale":"2024-09-16T07:47:44.448369+0000","last_undegraded":"2024-09-16T07:47:44.448369+0000","last_fullsized":"2024-09-16T07:47:44.448369+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326073+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:47:09.326073+0000","last_peered":"2024-09-16T07:47:09.326073+0000","last_clean":"2024-09-16T07:47:09.326073+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:47:09.326073+0000","last_undegraded":"2024-09-16T07:47:09.326073+0000","last_fullsized":"2024-09-16T07:47:09.326073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"49'280","reported_seq":292,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.244481+0000","last_change":"2024-09-16T07:47:08.467569+0000","last_active":"2024-09-16T07:47:44.244481+0000","last_peered":"2024-09-16T07:47:44.244481+0000","last_clean":"2024-09-16T07:47:44.244481+0000","last_became_active":"2024-09-16T07:47:08.454580+0000","last_became_peered":"2024-09-16T07:47:08.454580+0000","last_unstale":"2024-09-16T07:47:44.244481+0000","last_undegraded":"2024-09-16T07:47:44.244481+0000","last_fullsized":"2024-09-16T07:47:44.244481+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.321147+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:47:09.321147+0000","last_peered":"2024-09-16T07:47:09.321147+0000","last_clean":"2024-09-16T07:47:09.321147+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:47:09.321147+0000","last_undegraded":"2024-09-16T07:47:09.321147+0000","last_fullsized":"2024-09-16T07:47:09.321147+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"49'432","reported_seq":444,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.817601+0000","last_change":"2024-09-16T07:47:08.508888+0000","last_active":"2024-09-16T07:47:42.817601+0000","last_peered":"2024-09-16T07:47:42.817601+0000","last_clean":"2024-09-16T07:47:42.817601+0000","last_became_active":"2024-09-16T07:47:08.500244+0000","last_became_peered":"2024-09-16T07:47:08.500244+0000","last_unstale":"2024-09-16T07:47:42.817601+0000","last_undegraded":"2024-09-16T07:47:42.817601+0000","last_fullsized":"2024-09-16T07:47:42.817601+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320068+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:47:09.320068+0000","last_peered":"2024-09-16T07:47:09.320068+0000","last_clean":"2024-09-16T07:47:09.320068+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:47:09.320068+0000","last_undegraded":"2024-09-16T07:47:09.320068+0000","last_fullsized":"2024-09-16T07:47:09.320068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":49938432,"num_objects":763,"num_object_clones":0,"num_object_copies":2289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6096,"num_write_kb":48768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74907648,"data_stored":149815296,"data_compressed":7732494,"data_compressed_allocated":74907648,"data_compressed_original":149815296,"omap_allocated":0,"internal_metadata":0},"log_size":6096,"ondisk_log_size":6096,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114060,"kb_used_data":20604,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94257780,"statfs":{"total":96636764160,"available":96519966720,"internally_reserved":0,"allocated":21098496,"data_stored":41495911,"data_compressed":2133947,"data_compressed_allocated":20672512,"data_compressed_original":41345024,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106656,"kb_used_data":17360,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94265184,"statfs":{"total":96636764160,"available":96527548416,"internally_reserved":0,"allocated":17776640,"data_stored":35319687,"data_compressed":1814808,"data_compressed_allocated":17330176,"data_compressed_original":35151872,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98972,"kb_used_data":13836,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94272868,"statfs":{"total":96636764160,"available":96535416832,"internally_reserved":0,"allocated":14168064,"data_stored":28102535,"data_compressed":1442227,"data_compressed_allocated":13721600,"data_compressed_original":27934720,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103680,"kb_used_data":22704,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94268160,"statfs":{"total":96636764160,"available":96530595840,"internally_reserved":0,"allocated":23248896,"data_stored":46272372,"data_compressed":2380017,"data_compressed_allocated":22806528,"data_compressed_original":46104576,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22937600,"data_stored":45875200,"data_compressed":2367746,"data_compressed_allocated":22937600,"data_compressed_original":45875200,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13848576,"data_stored":27697152,"data_compressed":1429533,"data_compressed_allocated":13848576,"data_compressed_original":27697152,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17313792,"data_stored":34627584,"data_compressed":1787309,"data_compressed_allocated":17313792,"data_compressed_original":34627584,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20807680,"data_stored":41615360,"data_compressed":2147906,"data_compressed_allocated":20807680,"data_compressed_original":41615360,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:04.388 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:04.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 55 16 9310 9294 1.32005 1.14062 0.0417506 0.094538 2024-09-16T07:48:04.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:04.529+0000 7f0151391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:04.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:04.537+0000 7f0151391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:05.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 56 16 9475 9459 1.3195 1.28906 0.105644 0.0946869 2024-09-16T07:48:06.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 57 16 9636 9620 1.31841 1.25781 0.112478 0.0947014 2024-09-16T07:48:06.887 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:07.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:07.022+0000 7f0b606a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:07.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:07.031+0000 7f0b606a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:07.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 58 16 9770 9754 1.31373 1.04688 0.132011 0.0950567 2024-09-16T07:48:08.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 59 16 9917 9901 1.31093 1.14844 0.119354 0.0952571 2024-09-16T07:48:08.649 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:08.649 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:08.649 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:48:08.649 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:48:08.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:08.781+0000 7fc2bd791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:08.794+0000 7fc2bd791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:08.958 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:08.958 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:08.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:48:09.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:09.110+0000 7f2762f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:09.127+0000 7f2762f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:09.149 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:09.150 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:09.156 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:09.156 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:09.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:48:09.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:09.296+0000 7fd7e9b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:09.309+0000 7fd7e9b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.334 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:09.334 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:09.334 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:09.334 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:09.334 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:09.334 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:09.335 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:09.335 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:09.335 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:09.335 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:09.335 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:09.335 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:09.338 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:09.338 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:09.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:48:09.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:48:09.399985+0000 min lat: 0.0161532 max lat: 0.271375 avg lat: 0.0953853 2024-09-16T07:48:09.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:48:09.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 60 16 10076 10060 1.30978 1.24219 0.0347454 0.0953853 2024-09-16T07:48:09.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:09.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:09.497+0000 7f75aa8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:09.517+0000 7f75aa8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.540 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:09.540 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:09.540 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:09.541 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:09.544 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:09.545 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:09.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:09.551+0000 7f8926b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:09.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:09.558+0000 7f8926b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:10.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 61 16 10224 10208 1.30726 1.15625 0.132995 0.0955054 2024-09-16T07:48:11.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 62 16 10380 10364 1.30583 1.21875 0.0736256 0.0956492 2024-09-16T07:48:11.716 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:11.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:11.854+0000 7f430e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:11.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:11.863+0000 7f430e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:12.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 63 16 10559 10543 1.3073 1.39844 0.127354 0.0955126 2024-09-16T07:48:13.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 64 16 10725 10709 1.30713 1.29688 0.0398388 0.0955403 2024-09-16T07:48:14.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:14.194+0000 7f578c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:14.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:14.210+0000 7f578c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:14.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 65 16 10866 10850 1.30397 1.10156 0.0621471 0.0957388 2024-09-16T07:48:14.545 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:14.546 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:14.546 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:14.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:14.684+0000 7f22112fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:14.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:14.695+0000 7f22112fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:15.021 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:48:15.022 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:48:15.043 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-16T07:48:13.795239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50528819,"num_objects":767,"num_object_clones":0,"num_object_copies":2301,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":6177,"num_write_kb":49876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6151,"ondisk_log_size":6151,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":423368,"kb_used_data":74504,"kb_used_omap":0,"kb_used_meta":348800,"kb_avail":377063992,"statfs":{"total":386547056640,"available":386113527808,"internally_reserved":0,"allocated":76292096,"data_stored":151190505,"data_compressed":7770999,"data_compressed_allocated":74530816,"data_compressed_original":150536192,"omap_allocated":0,"internal_metadata":357171200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002297"},"pg_stats":[{"pgid":"7.f","version":"49'424","reported_seq":436,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.548131+0000","last_change":"2024-09-16T07:47:08.477709+0000","last_active":"2024-09-16T07:47:44.548131+0000","last_peered":"2024-09-16T07:47:44.548131+0000","last_clean":"2024-09-16T07:47:44.548131+0000","last_became_active":"2024-09-16T07:47:08.464812+0000","last_became_peered":"2024-09-16T07:47:08.464812+0000","last_unstale":"2024-09-16T07:47:44.548131+0000","last_undegraded":"2024-09-16T07:47:44.548131+0000","last_fullsized":"2024-09-16T07:47:44.548131+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":424,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"49'496","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.465557+0000","last_change":"2024-09-16T07:47:08.422056+0000","last_active":"2024-09-16T07:47:44.465557+0000","last_peered":"2024-09-16T07:47:44.465557+0000","last_clean":"2024-09-16T07:47:44.465557+0000","last_became_active":"2024-09-16T07:47:08.410012+0000","last_became_peered":"2024-09-16T07:47:08.410012+0000","last_unstale":"2024-09-16T07:47:44.465557+0000","last_undegraded":"2024-09-16T07:47:44.465557+0000","last_fullsized":"2024-09-16T07:47:44.465557+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"49'348","reported_seq":360,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.746397+0000","last_change":"2024-09-16T07:47:08.481315+0000","last_active":"2024-09-16T07:47:44.746397+0000","last_peered":"2024-09-16T07:47:44.746397+0000","last_clean":"2024-09-16T07:47:44.746397+0000","last_became_active":"2024-09-16T07:47:08.470559+0000","last_became_peered":"2024-09-16T07:47:08.470559+0000","last_unstale":"2024-09-16T07:47:44.746397+0000","last_undegraded":"2024-09-16T07:47:44.746397+0000","last_fullsized":"2024-09-16T07:47:44.746397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2850816,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":348,"num_write_kb":2784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.496624+0000","last_change":"2024-09-16T07:47:08.443238+0000","last_active":"2024-09-16T07:47:44.496624+0000","last_peered":"2024-09-16T07:47:44.496624+0000","last_clean":"2024-09-16T07:47:44.496624+0000","last_became_active":"2024-09-16T07:47:08.433242+0000","last_became_peered":"2024-09-16T07:47:08.433242+0000","last_unstale":"2024-09-16T07:47:44.496624+0000","last_undegraded":"2024-09-16T07:47:44.496624+0000","last_fullsized":"2024-09-16T07:47:44.496624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"49'376","reported_seq":388,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.688235+0000","last_change":"2024-09-16T07:47:08.440399+0000","last_active":"2024-09-16T07:47:44.688235+0000","last_peered":"2024-09-16T07:47:44.688235+0000","last_clean":"2024-09-16T07:47:44.688235+0000","last_became_active":"2024-09-16T07:47:08.432293+0000","last_became_peered":"2024-09-16T07:47:08.432293+0000","last_unstale":"2024-09-16T07:47:44.688235+0000","last_undegraded":"2024-09-16T07:47:44.688235+0000","last_fullsized":"2024-09-16T07:47:44.688235+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"49'328","reported_seq":340,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.576070+0000","last_change":"2024-09-16T07:47:08.475491+0000","last_active":"2024-09-16T07:47:43.576070+0000","last_peered":"2024-09-16T07:47:43.576070+0000","last_clean":"2024-09-16T07:47:43.576070+0000","last_became_active":"2024-09-16T07:47:08.458228+0000","last_became_peered":"2024-09-16T07:47:08.458228+0000","last_unstale":"2024-09-16T07:47:43.576070+0000","last_undegraded":"2024-09-16T07:47:43.576070+0000","last_fullsized":"2024-09-16T07:47:43.576070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2686976,"num_objects":41,"num_object_clones":0,"num_object_copies":123,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":328,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"49'332","reported_seq":344,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.750765+0000","last_change":"2024-09-16T07:47:08.483381+0000","last_active":"2024-09-16T07:47:44.750765+0000","last_peered":"2024-09-16T07:47:44.750765+0000","last_clean":"2024-09-16T07:47:44.750765+0000","last_became_active":"2024-09-16T07:47:08.474048+0000","last_became_peered":"2024-09-16T07:47:08.474048+0000","last_unstale":"2024-09-16T07:47:44.750765+0000","last_undegraded":"2024-09-16T07:47:44.750765+0000","last_fullsized":"2024-09-16T07:47:44.750765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2719744,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":332,"num_write_kb":2656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"49'312","reported_seq":324,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.662222+0000","last_change":"2024-09-16T07:47:08.466199+0000","last_active":"2024-09-16T07:47:42.662222+0000","last_peered":"2024-09-16T07:47:42.662222+0000","last_clean":"2024-09-16T07:47:42.662222+0000","last_became_active":"2024-09-16T07:47:08.458169+0000","last_became_peered":"2024-09-16T07:47:08.458169+0000","last_unstale":"2024-09-16T07:47:42.662222+0000","last_undegraded":"2024-09-16T07:47:42.662222+0000","last_fullsized":"2024-09-16T07:47:42.662222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"49'432","reported_seq":444,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.926046+0000","last_change":"2024-09-16T07:47:08.522521+0000","last_active":"2024-09-16T07:47:43.926046+0000","last_peered":"2024-09-16T07:47:43.926046+0000","last_clean":"2024-09-16T07:47:43.926046+0000","last_became_active":"2024-09-16T07:47:08.512943+0000","last_became_peered":"2024-09-16T07:47:08.512943+0000","last_unstale":"2024-09-16T07:47:43.926046+0000","last_undegraded":"2024-09-16T07:47:43.926046+0000","last_fullsized":"2024-09-16T07:47:43.926046+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320092+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:47:09.320092+0000","last_peered":"2024-09-16T07:47:09.320092+0000","last_clean":"2024-09-16T07:47:09.320092+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:47:09.320092+0000","last_undegraded":"2024-09-16T07:47:09.320092+0000","last_fullsized":"2024-09-16T07:47:09.320092+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":122,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.329039+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:47:09.329039+0000","last_peered":"2024-09-16T07:47:09.329039+0000","last_clean":"2024-09-16T07:47:09.329039+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:47:09.329039+0000","last_undegraded":"2024-09-16T07:47:09.329039+0000","last_fullsized":"2024-09-16T07:47:09.329039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:43.985641+0000","last_change":"2024-09-16T07:47:08.461993+0000","last_active":"2024-09-16T07:47:43.985641+0000","last_peered":"2024-09-16T07:47:43.985641+0000","last_clean":"2024-09-16T07:47:43.985641+0000","last_became_active":"2024-09-16T07:47:08.450836+0000","last_became_peered":"2024-09-16T07:47:08.450836+0000","last_unstale":"2024-09-16T07:47:43.985641+0000","last_undegraded":"2024-09-16T07:47:43.985641+0000","last_fullsized":"2024-09-16T07:47:43.985641+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320986+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:47:09.320986+0000","last_peered":"2024-09-16T07:47:09.320986+0000","last_clean":"2024-09-16T07:47:09.320986+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:47:09.320986+0000","last_undegraded":"2024-09-16T07:47:09.320986+0000","last_fullsized":"2024-09-16T07:47:09.320986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"49'360","reported_seq":372,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.922962+0000","last_change":"2024-09-16T07:47:08.517634+0000","last_active":"2024-09-16T07:47:42.922962+0000","last_peered":"2024-09-16T07:47:42.922962+0000","last_clean":"2024-09-16T07:47:42.922962+0000","last_became_active":"2024-09-16T07:47:08.504996+0000","last_became_peered":"2024-09-16T07:47:08.504996+0000","last_unstale":"2024-09-16T07:47:42.922962+0000","last_undegraded":"2024-09-16T07:47:42.922962+0000","last_fullsized":"2024-09-16T07:47:42.922962+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.328134+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:47:09.328134+0000","last_peered":"2024-09-16T07:47:09.328134+0000","last_clean":"2024-09-16T07:47:09.328134+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:47:09.328134+0000","last_undegraded":"2024-09-16T07:47:09.328134+0000","last_fullsized":"2024-09-16T07:47:09.328134+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"49'408","reported_seq":420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.545243+0000","last_change":"2024-09-16T07:47:08.460081+0000","last_active":"2024-09-16T07:47:42.545243+0000","last_peered":"2024-09-16T07:47:42.545243+0000","last_clean":"2024-09-16T07:47:42.545243+0000","last_became_active":"2024-09-16T07:47:08.449752+0000","last_became_peered":"2024-09-16T07:47:08.449752+0000","last_unstale":"2024-09-16T07:47:42.545243+0000","last_undegraded":"2024-09-16T07:47:42.545243+0000","last_fullsized":"2024-09-16T07:47:42.545243+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":123,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326852+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:47:09.326852+0000","last_peered":"2024-09-16T07:47:09.326852+0000","last_clean":"2024-09-16T07:47:09.326852+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:47:09.326852+0000","last_undegraded":"2024-09-16T07:47:09.326852+0000","last_fullsized":"2024-09-16T07:47:09.326852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"49'416","reported_seq":428,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.384650+0000","last_change":"2024-09-16T07:47:08.437239+0000","last_active":"2024-09-16T07:47:44.384650+0000","last_peered":"2024-09-16T07:47:44.384650+0000","last_clean":"2024-09-16T07:47:44.384650+0000","last_became_active":"2024-09-16T07:47:08.428482+0000","last_became_peered":"2024-09-16T07:47:08.428482+0000","last_unstale":"2024-09-16T07:47:44.384650+0000","last_undegraded":"2024-09-16T07:47:44.384650+0000","last_fullsized":"2024-09-16T07:47:44.384650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.330235+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:47:09.330235+0000","last_peered":"2024-09-16T07:47:09.330235+0000","last_clean":"2024-09-16T07:47:09.330235+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:47:09.330235+0000","last_undegraded":"2024-09-16T07:47:09.330235+0000","last_fullsized":"2024-09-16T07:47:09.330235+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"49'384","reported_seq":396,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.448369+0000","last_change":"2024-09-16T07:47:08.420660+0000","last_active":"2024-09-16T07:47:44.448369+0000","last_peered":"2024-09-16T07:47:44.448369+0000","last_clean":"2024-09-16T07:47:44.448369+0000","last_became_active":"2024-09-16T07:47:08.412209+0000","last_became_peered":"2024-09-16T07:47:08.412209+0000","last_unstale":"2024-09-16T07:47:44.448369+0000","last_undegraded":"2024-09-16T07:47:44.448369+0000","last_fullsized":"2024-09-16T07:47:44.448369+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326073+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:47:09.326073+0000","last_peered":"2024-09-16T07:47:09.326073+0000","last_clean":"2024-09-16T07:47:09.326073+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:47:09.326073+0000","last_undegraded":"2024-09-16T07:47:09.326073+0000","last_fullsized":"2024-09-16T07:47:09.326073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"49'280","reported_seq":292,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:44.244481+0000","last_change":"2024-09-16T07:47:08.467569+0000","last_active":"2024-09-16T07:47:44.244481+0000","last_peered":"2024-09-16T07:47:44.244481+0000","last_clean":"2024-09-16T07:47:44.244481+0000","last_became_active":"2024-09-16T07:47:08.454580+0000","last_became_peered":"2024-09-16T07:47:08.454580+0000","last_unstale":"2024-09-16T07:47:44.244481+0000","last_undegraded":"2024-09-16T07:47:44.244481+0000","last_fullsized":"2024-09-16T07:47:44.244481+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.321147+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:47:09.321147+0000","last_peered":"2024-09-16T07:47:09.321147+0000","last_clean":"2024-09-16T07:47:09.321147+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:47:09.321147+0000","last_undegraded":"2024-09-16T07:47:09.321147+0000","last_fullsized":"2024-09-16T07:47:09.321147+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"49'432","reported_seq":444,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:42.817601+0000","last_change":"2024-09-16T07:47:08.508888+0000","last_active":"2024-09-16T07:47:42.817601+0000","last_peered":"2024-09-16T07:47:42.817601+0000","last_clean":"2024-09-16T07:47:42.817601+0000","last_became_active":"2024-09-16T07:47:08.500244+0000","last_became_peered":"2024-09-16T07:47:08.500244+0000","last_unstale":"2024-09-16T07:47:42.817601+0000","last_undegraded":"2024-09-16T07:47:42.817601+0000","last_fullsized":"2024-09-16T07:47:42.817601+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320068+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:47:09.320068+0000","last_peered":"2024-09-16T07:47:09.320068+0000","last_clean":"2024-09-16T07:47:09.320068+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:47:09.320068+0000","last_undegraded":"2024-09-16T07:47:09.320068+0000","last_fullsized":"2024-09-16T07:47:09.320068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":49938432,"num_objects":763,"num_object_clones":0,"num_object_copies":2289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6096,"num_write_kb":48768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74907648,"data_stored":149815296,"data_compressed":7732494,"data_compressed_allocated":74907648,"data_compressed_original":149815296,"omap_allocated":0,"internal_metadata":0},"log_size":6096,"ondisk_log_size":6096,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114060,"kb_used_data":20604,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94257780,"statfs":{"total":96636764160,"available":96519966720,"internally_reserved":0,"allocated":21098496,"data_stored":41495911,"data_compressed":2133947,"data_compressed_allocated":20672512,"data_compressed_original":41345024,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106656,"kb_used_data":17360,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94265184,"statfs":{"total":96636764160,"available":96527548416,"internally_reserved":0,"allocated":17776640,"data_stored":35319687,"data_compressed":1814808,"data_compressed_allocated":17330176,"data_compressed_original":35151872,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98972,"kb_used_data":13836,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94272868,"statfs":{"total":96636764160,"available":96535416832,"internally_reserved":0,"allocated":14168064,"data_stored":28102535,"data_compressed":1442227,"data_compressed_allocated":13721600,"data_compressed_original":27934720,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706143,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103680,"kb_used_data":22704,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94268160,"statfs":{"total":96636764160,"available":96530595840,"internally_reserved":0,"allocated":23248896,"data_stored":46272372,"data_compressed":2380017,"data_compressed_allocated":22806528,"data_compressed_original":46104576,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22937600,"data_stored":45875200,"data_compressed":2367746,"data_compressed_allocated":22937600,"data_compressed_original":45875200,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13848576,"data_stored":27697152,"data_compressed":1429533,"data_compressed_allocated":13848576,"data_compressed_original":27697152,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17313792,"data_stored":34627584,"data_compressed":1787309,"data_compressed_allocated":17313792,"data_compressed_original":34627584,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20807680,"data_stored":41615360,"data_compressed":2147906,"data_compressed_allocated":20807680,"data_compressed_original":41615360,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:15.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 66 16 11035 11019 1.30422 1.32031 0.152556 0.095792 2024-09-16T07:48:16.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 67 16 11186 11170 1.30236 1.17969 0.112185 0.0959217 2024-09-16T07:48:16.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:16.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:16.689+0000 7fb852d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:16.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:16.698+0000 7fb852d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:17.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 68 16 11325 11309 1.29917 1.08594 0.11713 0.0961184 2024-09-16T07:48:18.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 69 16 11468 11452 1.29653 1.11719 0.108361 0.096308 2024-09-16T07:48:18.983 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:19.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:19.140+0000 7f2f97c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:19.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:19.146+0000 7f2f97c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:19.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 70 16 11637 11621 1.29687 1.32031 0.0490886 0.0963271 2024-09-16T07:48:20.044 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:20.045 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:20.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:48:20.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:20.176+0000 7f2b8446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:20.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:20.187+0000 7f2b8446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:20.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 71 16 11777 11761 1.29401 1.09375 0.0864748 0.0964966 2024-09-16T07:48:20.442 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:48:20.442 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:48:20.463 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-16T07:48:19.796355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":90055219,"num_objects":1370,"num_object_clones":0,"num_object_copies":4110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":11002,"num_write_kb":88476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10976,"ondisk_log_size":10976,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":481336,"kb_used_data":132468,"kb_used_omap":0,"kb_used_meta":348800,"kb_avail":377006024,"statfs":{"total":386547056640,"available":386054168576,"internally_reserved":0,"allocated":135647232,"data_stored":269900777,"data_compressed":13900692,"data_compressed_allocated":133885952,"data_compressed_original":269246464,"omap_allocated":0,"internal_metadata":357171200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39526400,"num_objects":603,"num_object_clones":0,"num_object_copies":1809,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4825,"num_write_kb":38600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002220"},"pg_stats":[{"pgid":"7.f","version":"49'720","reported_seq":732,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:12.644118+0000","last_change":"2024-09-16T07:47:08.477709+0000","last_active":"2024-09-16T07:48:12.644118+0000","last_peered":"2024-09-16T07:48:12.644118+0000","last_clean":"2024-09-16T07:48:12.644118+0000","last_became_active":"2024-09-16T07:47:08.464812+0000","last_became_peered":"2024-09-16T07:47:08.464812+0000","last_unstale":"2024-09-16T07:48:12.644118+0000","last_undegraded":"2024-09-16T07:48:12.644118+0000","last_fullsized":"2024-09-16T07:48:12.644118+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"49'776","reported_seq":788,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.741667+0000","last_change":"2024-09-16T07:47:08.422056+0000","last_active":"2024-09-16T07:48:14.741667+0000","last_peered":"2024-09-16T07:48:14.741667+0000","last_clean":"2024-09-16T07:48:14.741667+0000","last_became_active":"2024-09-16T07:47:08.410012+0000","last_became_peered":"2024-09-16T07:47:08.410012+0000","last_unstale":"2024-09-16T07:48:14.741667+0000","last_undegraded":"2024-09-16T07:48:14.741667+0000","last_fullsized":"2024-09-16T07:48:14.741667+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"49'624","reported_seq":636,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:13.319832+0000","last_change":"2024-09-16T07:47:08.481315+0000","last_active":"2024-09-16T07:48:13.319832+0000","last_peered":"2024-09-16T07:48:13.319832+0000","last_clean":"2024-09-16T07:48:13.319832+0000","last_became_active":"2024-09-16T07:47:08.470559+0000","last_became_peered":"2024-09-16T07:47:08.470559+0000","last_unstale":"2024-09-16T07:48:13.319832+0000","last_undegraded":"2024-09-16T07:48:13.319832+0000","last_fullsized":"2024-09-16T07:48:13.319832+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"49'704","reported_seq":716,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:12.433734+0000","last_change":"2024-09-16T07:47:08.443238+0000","last_active":"2024-09-16T07:48:12.433734+0000","last_peered":"2024-09-16T07:48:12.433734+0000","last_clean":"2024-09-16T07:48:12.433734+0000","last_became_active":"2024-09-16T07:47:08.433242+0000","last_became_peered":"2024-09-16T07:47:08.433242+0000","last_unstale":"2024-09-16T07:48:12.433734+0000","last_undegraded":"2024-09-16T07:48:12.433734+0000","last_fullsized":"2024-09-16T07:48:12.433734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767168,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":5632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"49'624","reported_seq":636,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:13.491425+0000","last_change":"2024-09-16T07:47:08.440399+0000","last_active":"2024-09-16T07:48:13.491425+0000","last_peered":"2024-09-16T07:48:13.491425+0000","last_clean":"2024-09-16T07:48:13.491425+0000","last_became_active":"2024-09-16T07:47:08.432293+0000","last_became_peered":"2024-09-16T07:47:08.432293+0000","last_unstale":"2024-09-16T07:48:13.491425+0000","last_undegraded":"2024-09-16T07:48:13.491425+0000","last_fullsized":"2024-09-16T07:48:13.491425+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5111808,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":4992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"49'688","reported_seq":700,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.530488+0000","last_change":"2024-09-16T07:47:08.475491+0000","last_active":"2024-09-16T07:48:14.530488+0000","last_peered":"2024-09-16T07:48:14.530488+0000","last_clean":"2024-09-16T07:48:14.530488+0000","last_became_active":"2024-09-16T07:47:08.458228+0000","last_became_peered":"2024-09-16T07:47:08.458228+0000","last_unstale":"2024-09-16T07:48:14.530488+0000","last_undegraded":"2024-09-16T07:48:14.530488+0000","last_fullsized":"2024-09-16T07:48:14.530488+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.9","version":"49'640","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.718182+0000","last_change":"2024-09-16T07:47:08.483381+0000","last_active":"2024-09-16T07:48:14.718182+0000","last_peered":"2024-09-16T07:48:14.718182+0000","last_clean":"2024-09-16T07:48:14.718182+0000","last_became_active":"2024-09-16T07:47:08.474048+0000","last_became_peered":"2024-09-16T07:47:08.474048+0000","last_unstale":"2024-09-16T07:48:14.718182+0000","last_undegraded":"2024-09-16T07:48:14.718182+0000","last_fullsized":"2024-09-16T07:48:14.718182+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"49'656","reported_seq":668,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.078646+0000","last_change":"2024-09-16T07:47:08.466199+0000","last_active":"2024-09-16T07:48:14.078646+0000","last_peered":"2024-09-16T07:48:14.078646+0000","last_clean":"2024-09-16T07:48:14.078646+0000","last_became_active":"2024-09-16T07:47:08.458169+0000","last_became_peered":"2024-09-16T07:47:08.458169+0000","last_unstale":"2024-09-16T07:48:14.078646+0000","last_undegraded":"2024-09-16T07:48:14.078646+0000","last_fullsized":"2024-09-16T07:48:14.078646+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5373952,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":656,"num_write_kb":5248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"49'784","reported_seq":796,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.544200+0000","last_change":"2024-09-16T07:47:08.522521+0000","last_active":"2024-09-16T07:48:14.544200+0000","last_peered":"2024-09-16T07:48:14.544200+0000","last_clean":"2024-09-16T07:48:14.544200+0000","last_became_active":"2024-09-16T07:47:08.512943+0000","last_became_peered":"2024-09-16T07:47:08.512943+0000","last_unstale":"2024-09-16T07:48:14.544200+0000","last_undegraded":"2024-09-16T07:48:14.544200+0000","last_fullsized":"2024-09-16T07:48:14.544200+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320092+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:47:09.320092+0000","last_peered":"2024-09-16T07:47:09.320092+0000","last_clean":"2024-09-16T07:47:09.320092+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:47:09.320092+0000","last_undegraded":"2024-09-16T07:47:09.320092+0000","last_fullsized":"2024-09-16T07:47:09.320092+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":122,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.329039+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:47:09.329039+0000","last_peered":"2024-09-16T07:47:09.329039+0000","last_clean":"2024-09-16T07:47:09.329039+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:47:09.329039+0000","last_undegraded":"2024-09-16T07:47:09.329039+0000","last_fullsized":"2024-09-16T07:47:09.329039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"49'752","reported_seq":764,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.618581+0000","last_change":"2024-09-16T07:47:08.461993+0000","last_active":"2024-09-16T07:48:14.618581+0000","last_peered":"2024-09-16T07:48:14.618581+0000","last_clean":"2024-09-16T07:48:14.618581+0000","last_became_active":"2024-09-16T07:47:08.450836+0000","last_became_peered":"2024-09-16T07:47:08.450836+0000","last_unstale":"2024-09-16T07:48:14.618581+0000","last_undegraded":"2024-09-16T07:48:14.618581+0000","last_fullsized":"2024-09-16T07:48:14.618581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":752,"num_write_kb":6016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320986+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:47:09.320986+0000","last_peered":"2024-09-16T07:47:09.320986+0000","last_clean":"2024-09-16T07:47:09.320986+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:47:09.320986+0000","last_undegraded":"2024-09-16T07:47:09.320986+0000","last_fullsized":"2024-09-16T07:47:09.320986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"49'608","reported_seq":620,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:13.504732+0000","last_change":"2024-09-16T07:47:08.517634+0000","last_active":"2024-09-16T07:48:13.504732+0000","last_peered":"2024-09-16T07:48:13.504732+0000","last_clean":"2024-09-16T07:48:13.504732+0000","last_became_active":"2024-09-16T07:47:08.504996+0000","last_became_peered":"2024-09-16T07:47:08.504996+0000","last_unstale":"2024-09-16T07:48:13.504732+0000","last_undegraded":"2024-09-16T07:48:13.504732+0000","last_fullsized":"2024-09-16T07:48:13.504732+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.328134+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:47:09.328134+0000","last_peered":"2024-09-16T07:47:09.328134+0000","last_clean":"2024-09-16T07:47:09.328134+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:47:09.328134+0000","last_undegraded":"2024-09-16T07:47:09.328134+0000","last_fullsized":"2024-09-16T07:47:09.328134+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"49'720","reported_seq":732,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:11.956940+0000","last_change":"2024-09-16T07:47:08.460081+0000","last_active":"2024-09-16T07:48:11.956940+0000","last_peered":"2024-09-16T07:48:11.956940+0000","last_clean":"2024-09-16T07:48:11.956940+0000","last_became_active":"2024-09-16T07:47:08.449752+0000","last_became_peered":"2024-09-16T07:47:08.449752+0000","last_unstale":"2024-09-16T07:48:11.956940+0000","last_undegraded":"2024-09-16T07:48:11.956940+0000","last_fullsized":"2024-09-16T07:48:11.956940+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":5760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":123,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326852+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:47:09.326852+0000","last_peered":"2024-09-16T07:47:09.326852+0000","last_clean":"2024-09-16T07:47:09.326852+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:47:09.326852+0000","last_undegraded":"2024-09-16T07:47:09.326852+0000","last_fullsized":"2024-09-16T07:47:09.326852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"49'744","reported_seq":756,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:12.990189+0000","last_change":"2024-09-16T07:47:08.437239+0000","last_active":"2024-09-16T07:48:12.990189+0000","last_peered":"2024-09-16T07:48:12.990189+0000","last_clean":"2024-09-16T07:48:12.990189+0000","last_became_active":"2024-09-16T07:47:08.428482+0000","last_became_peered":"2024-09-16T07:47:08.428482+0000","last_unstale":"2024-09-16T07:48:12.990189+0000","last_undegraded":"2024-09-16T07:48:12.990189+0000","last_fullsized":"2024-09-16T07:48:12.990189+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6094848,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":5952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.330235+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:47:09.330235+0000","last_peered":"2024-09-16T07:47:09.330235+0000","last_clean":"2024-09-16T07:47:09.330235+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:47:09.330235+0000","last_undegraded":"2024-09-16T07:47:09.330235+0000","last_fullsized":"2024-09-16T07:47:09.330235+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"49'569","reported_seq":581,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.311761+0000","last_change":"2024-09-16T07:47:08.420660+0000","last_active":"2024-09-16T07:48:14.311761+0000","last_peered":"2024-09-16T07:48:14.311761+0000","last_clean":"2024-09-16T07:48:14.311761+0000","last_became_active":"2024-09-16T07:47:08.412209+0000","last_became_peered":"2024-09-16T07:47:08.412209+0000","last_unstale":"2024-09-16T07:48:14.311761+0000","last_undegraded":"2024-09-16T07:48:14.311761+0000","last_fullsized":"2024-09-16T07:48:14.311761+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4661248,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":569,"num_write_kb":4552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326073+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:47:09.326073+0000","last_peered":"2024-09-16T07:47:09.326073+0000","last_clean":"2024-09-16T07:47:09.326073+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:47:09.326073+0000","last_undegraded":"2024-09-16T07:47:09.326073+0000","last_fullsized":"2024-09-16T07:47:09.326073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3","version":"49'616","reported_seq":628,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.242060+0000","last_change":"2024-09-16T07:47:08.467569+0000","last_active":"2024-09-16T07:48:14.242060+0000","last_peered":"2024-09-16T07:48:14.242060+0000","last_clean":"2024-09-16T07:48:14.242060+0000","last_became_active":"2024-09-16T07:47:08.454580+0000","last_became_peered":"2024-09-16T07:47:08.454580+0000","last_unstale":"2024-09-16T07:48:14.242060+0000","last_undegraded":"2024-09-16T07:48:14.242060+0000","last_fullsized":"2024-09-16T07:48:14.242060+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.321147+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:47:09.321147+0000","last_peered":"2024-09-16T07:47:09.321147+0000","last_clean":"2024-09-16T07:47:09.321147+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:47:09.321147+0000","last_undegraded":"2024-09-16T07:47:09.321147+0000","last_fullsized":"2024-09-16T07:47:09.321147+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"49'696","reported_seq":708,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:48:14.634452+0000","last_change":"2024-09-16T07:47:08.508888+0000","last_active":"2024-09-16T07:48:14.634452+0000","last_peered":"2024-09-16T07:48:14.634452+0000","last_clean":"2024-09-16T07:48:14.634452+0000","last_became_active":"2024-09-16T07:47:08.500244+0000","last_became_peered":"2024-09-16T07:47:08.500244+0000","last_unstale":"2024-09-16T07:48:14.634452+0000","last_undegraded":"2024-09-16T07:48:14.634452+0000","last_fullsized":"2024-09-16T07:48:14.634452+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:47:07.294401+0000","last_clean_scrub_stamp":"2024-09-16T07:47:07.294401+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":696,"num_write_kb":5568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320068+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:47:09.320068+0000","last_peered":"2024-09-16T07:47:09.320068+0000","last_clean":"2024-09-16T07:47:09.320068+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:47:09.320068+0000","last_undegraded":"2024-09-16T07:47:09.320068+0000","last_fullsized":"2024-09-16T07:47:09.320068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":89464832,"num_objects":1366,"num_object_clones":0,"num_object_copies":4098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10921,"num_write_kb":87368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134172672,"data_stored":268345344,"data_compressed":13852881,"data_compressed_allocated":134172672,"data_compressed_original":268345344,"omap_allocated":0,"internal_metadata":0},"log_size":10921,"ondisk_log_size":10921,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125828,"kb_used_data":36532,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94246012,"statfs":{"total":96636764160,"available":96507916288,"internally_reserved":0,"allocated":37408768,"data_stored":74116455,"data_compressed":3818333,"data_compressed_allocated":36982784,"data_compressed_original":73965568,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":116036,"kb_used_data":30896,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94255804,"statfs":{"total":96636764160,"available":96517943296,"internally_reserved":0,"allocated":31637504,"data_stored":63041415,"data_compressed":3246240,"data_compressed_allocated":31191040,"data_compressed_original":62873600,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117600,"kb_used_data":24144,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94254240,"statfs":{"total":96636764160,"available":96516341760,"internally_reserved":0,"allocated":24723456,"data_stored":49213319,"data_compressed":2532298,"data_compressed_allocated":24276992,"data_compressed_original":49045504,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121872,"kb_used_data":40896,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94249968,"statfs":{"total":96636764160,"available":96511967232,"internally_reserved":0,"allocated":41877504,"data_stored":83529588,"data_compressed":4303821,"data_compressed_allocated":41435136,"data_compressed_original":83361792,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41553920,"data_stored":83107840,"data_compressed":4290281,"data_compressed_allocated":41553920,"data_compressed_original":83107840,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24285184,"data_stored":48570368,"data_compressed":2507337,"data_compressed_allocated":24285184,"data_compressed_original":48570368,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31170560,"data_stored":62341120,"data_compressed":3218318,"data_compressed_allocated":31170560,"data_compressed_original":62341120,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37163008,"data_stored":74326016,"data_compressed":3836945,"data_compressed_allocated":37163008,"data_compressed_original":74326016,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:48:21.340 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:21.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 72 16 11933 11917 1.29296 1.21875 0.0959911 0.0965886 2024-09-16T07:48:21.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:21.478+0000 7f1770591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:21.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:21.485+0000 7f1770591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:22.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 73 16 12069 12053 1.2898 1.0625 0.0868167 0.0968368 2024-09-16T07:48:23.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 74 16 12218 12202 1.2881 1.16406 0.06344 0.0969482 2024-09-16T07:48:23.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:23.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:23.968+0000 7fa485991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:23.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:23.975+0000 7fa485991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:24.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 75 16 12366 12350 1.28634 1.15625 0.0740254 0.0970879 2024-09-16T07:48:25.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 76 16 12511 12495 1.28432 1.13281 0.134044 0.0972355 2024-09-16T07:48:25.466 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:25.466 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:25.467 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:48:25.467 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:48:25.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:25.603+0000 7f144ff11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:25.615+0000 7f144ff11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:25.899 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:25.899 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:25.899 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:25.899 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:25.899 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:25.899 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:25.899 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:25.899 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:25.900 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:25.902 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:25.902 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:25.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:48:26.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:26.068+0000 7fb9d6e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:26.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:26.081+0000 7fb9d6e57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:26.113 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:26.114 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:26.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:48:26.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:26.260+0000 7f47f0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:26.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:26.274+0000 7f47f0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:26.302 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:26.303 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:26.308 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:26.308 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:26.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:48:26.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 77 16 12672 12656 1.28398 1.25781 0.157334 0.097245 2024-09-16T07:48:26.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:26.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:26.472+0000 7f133e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:26.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:26.485+0000 7f133e991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:26.518 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:26.519 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:26.520 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:26.520 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:26.522 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:26.523 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:26.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:26.551+0000 7fa09a84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:26.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:26.559+0000 7fa09a84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:27.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 78 16 12825 12809 1.28284 1.19531 0.0792234 0.0973769 2024-09-16T07:48:28.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 79 16 12958 12942 1.27975 1.03906 0.0753292 0.0976039 2024-09-16T07:48:29.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:29.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:29.228+0000 7fc542511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:29.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:29.235+0000 7fc542511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:29.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:48:29.401760+0000 min lat: 0.0161532 max lat: 0.27191 avg lat: 0.097798 2024-09-16T07:48:29.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:48:29.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 80 16 13098 13082 1.27742 1.09375 0.0359076 0.097798 2024-09-16T07:48:30.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 81 16 13244 13228 1.27573 1.14062 0.0587589 0.0979303 2024-09-16T07:48:31.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 82 16 13406 13390 1.27561 1.26562 0.0371784 0.0979232 2024-09-16T07:48:31.523 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:31.524 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:31.524 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:48:31.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:48:31.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:31.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:31.656+0000 7f8cff47f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:31.668+0000 7f8cff47f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:31.689 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:31.693 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:31.693 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:31.694 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:48:31.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:31.708+0000 7f496d4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:31.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:31.714+0000 7f496d4a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:31.820+0000 7f5129191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:31.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:31.838+0000 7f5129191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:31.888 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:31.889 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:31.889 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:31.889 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:31.891 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:31.892 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:31.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:48:32.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:32.085+0000 7fae72b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:32.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:32.100+0000 7fae72b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:32.126 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:32.128 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:32.130 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:32.131 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:32.131 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:48:32.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:32.297+0000 7f6b77391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:32.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:32.308+0000 7f6b77391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:32.324 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:32.324 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:32.325 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:32.325 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:32.325 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:32.325 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:32.325 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:32.326 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:32.326 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:32.326 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:32.326 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:32.326 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:32.327 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:32.328 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:32.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 83 16 13533 13517 1.27219 0.992188 0.0316728 0.0981344 2024-09-16T07:48:33.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 84 16 13657 13641 1.26858 0.96875 0.14481 0.098516 2024-09-16T07:48:33.956 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:34.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:34.091+0000 7f7578263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:34.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:34.101+0000 7f7578263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:34.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 85 16 13777 13761 1.26469 0.9375 0.150059 0.0987045 2024-09-16T07:48:35.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 86 16 13934 13918 1.26424 1.22656 0.0510921 0.0987779 2024-09-16T07:48:36.340 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:36.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 87 16 14085 14069 1.26327 1.17969 0.0648086 0.0988696 2024-09-16T07:48:36.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:36.479+0000 7fd98cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:36.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:36.487+0000 7fd98cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:37.329 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:37.329 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:37.329 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:48:37.329 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:48:37.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 88 16 14204 14188 1.25948 0.929688 0.110886 0.0991326 2024-09-16T07:48:37.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:37.483+0000 7f8a474ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:37.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:37.499+0000 7f8a474ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:37.555 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:37.559 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:37.559 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:37.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:48:37.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:37.712+0000 7fb01dd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:37.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:37.724+0000 7fb01dd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:37.742 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:37.747 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:37.748 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:37.748 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:48:37.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:37.883+0000 7ff82927d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:37.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:37.899+0000 7ff82927d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:38.069 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:38.069 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:38.069 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:38.069 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:38.069 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:38.069 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:38.070 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:38.070 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:38.070 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:38.070 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:38.070 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:38.070 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:38.073 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:38.073 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:38.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:48:38.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:38.197+0000 7f1ece2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:38.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:38.207+0000 7f1ece2fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:38.274 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:38.274 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:38.275 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:38.278 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:38.278 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:38.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 89 16 14361 14345 1.2591 1.22656 0.0410176 0.0991991 2024-09-16T07:48:38.776 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:38.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:38.928+0000 7fdf44791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:38.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:38.940+0000 7fdf44791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:39.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 90 15 14507 14492 1.25787 1.14844 0.143697 0.0993044 2024-09-16T07:48:40.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total time run: 90.1225 2024-09-16T07:48:40.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total writes made: 14507 2024-09-16T07:48:40.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Write size: 8192 2024-09-16T07:48:40.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object size: 65536 2024-09-16T07:48:40.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Bandwidth (MB/sec): 1.25758 2024-09-16T07:48:40.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Bandwidth: 0.137329 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max bandwidth (MB/sec): 1.59375 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min bandwidth (MB/sec): 0.929688 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average IOPS: 160 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev IOPS: 17.5781 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max IOPS: 204 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min IOPS: 119 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average Latency(s): 0.0993392 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Latency(s): 0.0434476 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max latency(s): 0.313475 2024-09-16T07:48:40.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min latency(s): 0.0161532 2024-09-16T07:48:40.429 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:48:41.442 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:41.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:41.604+0000 7f0d82b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:41.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:41.611+0000 7f0d82b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:43.278 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:43.279 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:43.279 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:48:43.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:48:43.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:43.444+0000 7f7027751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:43.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:43.462+0000 7f7027751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:43.606 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:43.606 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:43.607 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:43.611 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:43.611 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:43.612 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:48:43.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:43.786+0000 7f81d7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:43.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:43.802+0000 7f81d7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:43.831 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:43.832 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:43.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:43.837 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:43.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:48:43.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:43.986+0000 7fdbb6311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:44.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:44.003+0000 7fdbb6311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:44.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:44.209 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:44.209 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:44.209 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:44.209 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:44.209 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:44.210 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:44.210 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:44.210 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:44.210 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:44.210 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:44.210 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:44.210 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:44.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:44.207+0000 7f76e5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:44.214 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:44.215 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:44.215 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:48:44.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:44.218+0000 7f76e5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:44.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:44.383+0000 7f1a7ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:44.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:44.403+0000 7f1a7ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:44.444 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:44.444 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:46.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:46.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:46.830+0000 7fdf7ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:46.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:46.838+0000 7fdf7ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:49.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:49.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:49.368+0000 7f3651151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:49.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:49.379+0000 7f3651151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:49.445 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:49.445 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:49.445 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:48:49.445 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:48:49.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:49.597+0000 7f1f0f6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:49.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:49.615+0000 7f1f0f6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:49.721 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:49.722 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:49.723 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:49.726 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:49.726 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:49.727 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:48:49.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:49.875+0000 7f5111f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:49.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:49.890+0000 7f5111f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:49.920 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:49.920 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:49.920 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:49.920 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:49.920 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:49.920 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:49.921 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:49.924 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:49.924 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:49.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:48:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:50.133+0000 7f12eb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:50.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:50.149+0000 7f12eb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:50.223 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:50.226 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:50.226 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:50.226 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:48:50.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:50.391+0000 7f3aeb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:50.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:50.405+0000 7f3aeb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:50.426 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:50.426 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:50.426 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:50.427 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:50.427 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:50.427 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:50.427 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:50.427 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:50.427 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:50.428 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:50.428 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:50.428 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:50.429 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:50.429 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:50.437 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Removed 1814 objects 2024-09-16T07:48:50.437 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Clean up completed and total clean up time :10.0084 2024-09-16T07:48:51.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:51.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:51.982+0000 7f0f1c0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:51.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:51.988+0000 7f0f1c0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:53.053 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-09-16T07:48:53.053 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-09-16T07:48:53.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:53.159+0000 7f8656991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:53.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:53.171+0000 7f8656991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:54.090 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:54.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:54.198+0000 7f2a046d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:54.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:54.203+0000 7f2a046d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:54.293 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_4' removed 2024-09-16T07:48:54.317 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:48:54.318 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:48:54.319 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_5 2024-09-16T07:48:54.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_5 16 2024-09-16T07:48:54.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:54.511+0000 7f7ba5b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:54.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:54.530+0000 7f7ba5b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.294 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_5' created 2024-09-16T07:48:55.313 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_5 rados --yes-i-really-mean-it || true 2024-09-16T07:48:55.430 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:48:55.431 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:48:55.431 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:48:55.431 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:48:55.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.444+0000 7ffbf4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.458+0000 7ffbf4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.541+0000 7f6bde791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.550+0000 7f6bde791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:55.567 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:55.568 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:55.568 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:55.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:55.571 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:55.572 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:48:55.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.718+0000 7f6e7b093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.727+0000 7f6e7b093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.744 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:55.744 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:55.744 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:55.746 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:55.746 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:55.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:48:55.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.852+0000 7f886a8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.861+0000 7f886a8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:55.878 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:55.879 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:55.880 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:55.881 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:55.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:48:55.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.985+0000 7fdbc3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:55.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:55.994+0000 7fdbc3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:48:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:48:56.011 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:48:56.012 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:48:56.305 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_5' 2024-09-16T07:48:56.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:48:56.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:56.486+0000 7f0e8b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:56.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:56.495+0000 7f0e8b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:57.329 DEBUG:teuthology.orchestra.run.smithi137:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_5 bench 90 write' 2024-09-16T07:48:57.332 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:48:57.332 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:48:57.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:hints = 1 2024-09-16T07:48:57.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:48:57.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object prefix: benchmark_data_smithi137_52724 2024-09-16T07:48:57.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:48:57.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:48:58.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 1 16 212 196 1.53116 1.53125 0.0523432 0.0790397 2024-09-16T07:48:58.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:48:58.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:58.761+0000 7fa47b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:58.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:48:58.768+0000 7fa47b991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:48:59.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 2 16 419 403 1.5741 1.61719 0.0652474 0.078218 2024-09-16T07:49:00.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 3 16 622 606 1.578 1.58594 0.0744321 0.0782171 2024-09-16T07:49:00.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:01.012 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:01.012 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:01.013 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:49:01.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:01.120+0000 7f12b2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:01.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:01.133+0000 7f12b2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:01.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:01.173+0000 7fdfda991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:01.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:01.186+0000 7fdfda991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:01.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 4 16 807 791 1.5448 1.44531 0.120431 0.0798527 2024-09-16T07:49:01.504 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:49:01.505 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:49:01.521 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-16T07:48:59.804496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":517376,"kb_used_data":105984,"kb_used_omap":0,"kb_used_meta":411264,"kb_avail":376969984,"statfs":{"total":386547056640,"available":386017263616,"internally_reserved":0,"allocated":108527616,"data_stored":215637041,"data_compressed":11102067,"data_compressed_allocated":106754048,"data_compressed_original":214982656,"omap_allocated":0,"internal_metadata":421134336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.508964"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320092+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:47:09.320092+0000","last_peered":"2024-09-16T07:47:09.320092+0000","last_clean":"2024-09-16T07:47:09.320092+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:47:09.320092+0000","last_undegraded":"2024-09-16T07:47:09.320092+0000","last_fullsized":"2024-09-16T07:47:09.320092+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":122,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.329039+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:47:09.329039+0000","last_peered":"2024-09-16T07:47:09.329039+0000","last_clean":"2024-09-16T07:47:09.329039+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:47:09.329039+0000","last_undegraded":"2024-09-16T07:47:09.329039+0000","last_fullsized":"2024-09-16T07:47:09.329039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320986+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:47:09.320986+0000","last_peered":"2024-09-16T07:47:09.320986+0000","last_clean":"2024-09-16T07:47:09.320986+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:47:09.320986+0000","last_undegraded":"2024-09-16T07:47:09.320986+0000","last_fullsized":"2024-09-16T07:47:09.320986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.328134+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:47:09.328134+0000","last_peered":"2024-09-16T07:47:09.328134+0000","last_clean":"2024-09-16T07:47:09.328134+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:47:09.328134+0000","last_undegraded":"2024-09-16T07:47:09.328134+0000","last_fullsized":"2024-09-16T07:47:09.328134+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":123,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326852+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:47:09.326852+0000","last_peered":"2024-09-16T07:47:09.326852+0000","last_clean":"2024-09-16T07:47:09.326852+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:47:09.326852+0000","last_undegraded":"2024-09-16T07:47:09.326852+0000","last_fullsized":"2024-09-16T07:47:09.326852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.330235+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:47:09.330235+0000","last_peered":"2024-09-16T07:47:09.330235+0000","last_clean":"2024-09-16T07:47:09.330235+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:47:09.330235+0000","last_undegraded":"2024-09-16T07:47:09.330235+0000","last_fullsized":"2024-09-16T07:47:09.330235+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326073+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:47:09.326073+0000","last_peered":"2024-09-16T07:47:09.326073+0000","last_clean":"2024-09-16T07:47:09.326073+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:47:09.326073+0000","last_undegraded":"2024-09-16T07:47:09.326073+0000","last_fullsized":"2024-09-16T07:47:09.326073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.321147+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:47:09.321147+0000","last_peered":"2024-09-16T07:47:09.321147+0000","last_clean":"2024-09-16T07:47:09.321147+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:47:09.321147+0000","last_undegraded":"2024-09-16T07:47:09.321147+0000","last_fullsized":"2024-09-16T07:47:09.321147+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320068+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:47:09.320068+0000","last_peered":"2024-09-16T07:47:09.320068+0000","last_clean":"2024-09-16T07:47:09.320068+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:47:09.320068+0000","last_undegraded":"2024-09-16T07:47:09.320068+0000","last_fullsized":"2024-09-16T07:47:09.320068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135680,"kb_used_data":28336,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94236160,"statfs":{"total":96636764160,"available":96497827840,"internally_reserved":0,"allocated":29016064,"data_stored":57322879,"data_compressed":2952116,"data_compressed_allocated":28585984,"data_compressed_original":57171968,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706202,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142392,"kb_used_data":26728,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94229448,"statfs":{"total":96636764160,"available":96490954752,"internally_reserved":0,"allocated":27369472,"data_stored":54505351,"data_compressed":2806186,"data_compressed_allocated":26923008,"data_compressed_original":54337536,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108208,"kb_used_data":18880,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94263632,"statfs":{"total":96636764160,"available":96525959168,"internally_reserved":0,"allocated":19333120,"data_stored":38424479,"data_compressed":1975836,"data_compressed_allocated":18882560,"data_compressed_original":38256640,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131096,"kb_used_data":32040,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94240744,"statfs":{"total":96636764160,"available":96502521856,"internally_reserved":0,"allocated":32808960,"data_stored":65384332,"data_compressed":3367929,"data_compressed_allocated":32362496,"data_compressed_original":65216512,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:49:02.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 5 16 995 979 1.52957 1.46875 0.0713517 0.0811861 2024-09-16T07:49:03.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 6 16 1179 1163 1.5142 1.4375 0.116585 0.0817536 2024-09-16T07:49:03.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:03.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:03.587+0000 7f5a28493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:03.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:03.594+0000 7f5a28493640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:04.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 7 16 1362 1346 1.50211 1.42969 0.0315014 0.0828269 2024-09-16T07:49:05.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 8 16 1538 1522 1.48621 1.375 0.132666 0.0834812 2024-09-16T07:49:05.914 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:06.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:06.037+0000 7f535f4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:06.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:06.044+0000 7f535f4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:06.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 9 16 1738 1722 1.49467 1.5625 0.119548 0.0827548 2024-09-16T07:49:06.523 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:06.524 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:06.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:49:06.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:06.688+0000 7fb2c64fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:06.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:06.704+0000 7fb2c529b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:06.939 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:49:06.940 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:49:06.956 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-16T07:49:05.805692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":517376,"kb_used_data":105984,"kb_used_omap":0,"kb_used_meta":411264,"kb_avail":376969984,"statfs":{"total":386547056640,"available":386017263616,"internally_reserved":0,"allocated":108527616,"data_stored":215637041,"data_compressed":11102067,"data_compressed_allocated":106754048,"data_compressed_original":214982656,"omap_allocated":0,"internal_metadata":421134336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.496391"},"pg_stats":[{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320092+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:47:09.320092+0000","last_peered":"2024-09-16T07:47:09.320092+0000","last_clean":"2024-09-16T07:47:09.320092+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:47:09.320092+0000","last_undegraded":"2024-09-16T07:47:09.320092+0000","last_fullsized":"2024-09-16T07:47:09.320092+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":122,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.329039+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:47:09.329039+0000","last_peered":"2024-09-16T07:47:09.329039+0000","last_clean":"2024-09-16T07:47:09.329039+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:47:09.329039+0000","last_undegraded":"2024-09-16T07:47:09.329039+0000","last_fullsized":"2024-09-16T07:47:09.329039+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320986+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:47:09.320986+0000","last_peered":"2024-09-16T07:47:09.320986+0000","last_clean":"2024-09-16T07:47:09.320986+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:47:09.320986+0000","last_undegraded":"2024-09-16T07:47:09.320986+0000","last_fullsized":"2024-09-16T07:47:09.320986+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.328134+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:47:09.328134+0000","last_peered":"2024-09-16T07:47:09.328134+0000","last_clean":"2024-09-16T07:47:09.328134+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:47:09.328134+0000","last_undegraded":"2024-09-16T07:47:09.328134+0000","last_fullsized":"2024-09-16T07:47:09.328134+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":123,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326852+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:47:09.326852+0000","last_peered":"2024-09-16T07:47:09.326852+0000","last_clean":"2024-09-16T07:47:09.326852+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:47:09.326852+0000","last_undegraded":"2024-09-16T07:47:09.326852+0000","last_fullsized":"2024-09-16T07:47:09.326852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.330235+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:47:09.330235+0000","last_peered":"2024-09-16T07:47:09.330235+0000","last_clean":"2024-09-16T07:47:09.330235+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:47:09.330235+0000","last_undegraded":"2024-09-16T07:47:09.330235+0000","last_fullsized":"2024-09-16T07:47:09.330235+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.326073+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:47:09.326073+0000","last_peered":"2024-09-16T07:47:09.326073+0000","last_clean":"2024-09-16T07:47:09.326073+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:47:09.326073+0000","last_undegraded":"2024-09-16T07:47:09.326073+0000","last_fullsized":"2024-09-16T07:47:09.326073+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.321147+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:47:09.321147+0000","last_peered":"2024-09-16T07:47:09.321147+0000","last_clean":"2024-09-16T07:47:09.321147+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:47:09.321147+0000","last_undegraded":"2024-09-16T07:47:09.321147+0000","last_fullsized":"2024-09-16T07:47:09.321147+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:48:55.295023+0000","last_change":"2024-09-16T07:48:55.295023+0000","last_active":"2024-09-16T07:48:55.295023+0000","last_peered":"2024-09-16T07:48:55.295023+0000","last_clean":"2024-09-16T07:48:55.295023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:48:55.295023+0000","last_undegraded":"2024-09-16T07:48:55.295023+0000","last_fullsized":"2024-09-16T07:48:55.295023+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-16T07:47:09.320068+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:47:09.320068+0000","last_peered":"2024-09-16T07:47:09.320068+0000","last_clean":"2024-09-16T07:47:09.320068+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:47:09.320068+0000","last_undegraded":"2024-09-16T07:47:09.320068+0000","last_fullsized":"2024-09-16T07:47:09.320068+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135680,"kb_used_data":28336,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94236160,"statfs":{"total":96636764160,"available":96497827840,"internally_reserved":0,"allocated":29016064,"data_stored":57322879,"data_compressed":2952116,"data_compressed_allocated":28585984,"data_compressed_original":57171968,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706202,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142392,"kb_used_data":26728,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94229448,"statfs":{"total":96636764160,"available":96490954752,"internally_reserved":0,"allocated":27369472,"data_stored":54505351,"data_compressed":2806186,"data_compressed_allocated":26923008,"data_compressed_original":54337536,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108208,"kb_used_data":18880,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94263632,"statfs":{"total":96636764160,"available":96525959168,"internally_reserved":0,"allocated":19333120,"data_stored":38424479,"data_compressed":1975836,"data_compressed_allocated":18882560,"data_compressed_original":38256640,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131096,"kb_used_data":32040,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94240744,"statfs":{"total":96636764160,"available":96502521856,"internally_reserved":0,"allocated":32808960,"data_stored":65384332,"data_compressed":3367929,"data_compressed_allocated":32362496,"data_compressed_original":65216512,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:49:07.394 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 10 16 1927 1911 1.49284 1.47656 0.0679713 0.0833488 2024-09-16T07:49:08.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:08.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 11 15 2122 2107 1.49632 1.53125 0.0997676 0.0832768 2024-09-16T07:49:08.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:08.418+0000 7fe51c111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:08.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:08.427+0000 7fe51c111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:09.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 12 16 2313 2297 1.49531 1.48438 0.0954014 0.0833063 2024-09-16T07:49:10.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 13 16 2498 2482 1.49146 1.44531 0.0428162 0.083583 2024-09-16T07:49:10.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:10.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:10.939+0000 7f3c37a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:10.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:10.945+0000 7f3c37a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:11.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 14 16 2671 2655 1.48145 1.35156 0.0709924 0.0841395 2024-09-16T07:49:11.958 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:11.959 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:11.959 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:49:11.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:49:12.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:12.109+0000 7fce92f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:12.125+0000 7fce92f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:12.150 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:12.151 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:12.151 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:12.151 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:12.153 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:12.154 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:12.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:49:12.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:12.306+0000 7fc080b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:12.326+0000 7fc080b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:12.361 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:12.362 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:12.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:49:12.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 15 16 2863 2847 1.48268 1.5 0.0757923 0.0840241 2024-09-16T07:49:12.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:12.516+0000 7f3fabcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:12.531+0000 7f3fabcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:12.557 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:12.558 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:12.558 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:12.558 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:12.559 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:12.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:49:12.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:12.750+0000 7f83676a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:12.764+0000 7f83676a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:12.794 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:12.795 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:12.795 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:12.795 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:12.795 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:12.795 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:12.795 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:12.795 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:12.798 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:12.799 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:13.112 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:13.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:13.282+0000 7f7095d48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:13.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:13.291+0000 7f7095d48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:13.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 16 16 3053 3037 1.48278 1.48438 0.101634 0.0840088 2024-09-16T07:49:14.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 17 16 3252 3236 1.487 1.55469 0.107487 0.0838804 2024-09-16T07:49:15.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 18 16 3455 3439 1.49249 1.58594 0.0405443 0.0835124 2024-09-16T07:49:15.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:15.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:15.637+0000 7f5cb0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:15.647+0000 7f5cb0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:16.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 19 16 3656 3640 1.49658 1.57031 0.094057 0.0832729 2024-09-16T07:49:17.395 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:49:17.397282+0000 min lat: 0.0192692 max lat: 0.21032 avg lat: 0.083262 2024-09-16T07:49:17.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:49:17.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 20 16 3844 3828 1.49518 1.46875 0.120477 0.083262 2024-09-16T07:49:17.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:17.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:17.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:49:17.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:17.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:17.945+0000 7fbc87391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:17.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:17.955+0000 7fbc87391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:18.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:18.041+0000 7f11af111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:18.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:18.051+0000 7f11af111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:18.247 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:49:18.248 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:49:18.265 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-16T07:49:17.808378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27779635,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3400,"num_write_kb":27660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3374,"ondisk_log_size":3374,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":435568,"kb_used_data":40880,"kb_used_omap":0,"kb_used_meta":394624,"kb_avail":377051792,"statfs":{"total":386547056640,"available":386101035008,"internally_reserved":0,"allocated":41861120,"data_stored":82090069,"data_compressed":4200033,"data_compressed_allocated":39952384,"data_compressed_original":81379328,"omap_allocated":0,"internal_metadata":404094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27189248,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3319,"num_write_kb":26552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002685"},"pg_stats":[{"pgid":"8.7","version":"53'248","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.712056+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:49:13.712056+0000","last_peered":"2024-09-16T07:49:13.712056+0000","last_clean":"2024-09-16T07:49:13.712056+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:49:13.712056+0000","last_undegraded":"2024-09-16T07:49:13.712056+0000","last_fullsized":"2024-09-16T07:49:13.712056+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"53'144","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.109534+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:49:14.109534+0000","last_peered":"2024-09-16T07:49:14.109534+0000","last_clean":"2024-09-16T07:49:14.109534+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:49:14.109534+0000","last_undegraded":"2024-09-16T07:49:14.109534+0000","last_fullsized":"2024-09-16T07:49:14.109534+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"53'256","reported_seq":268,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.648589+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:49:14.648589+0000","last_peered":"2024-09-16T07:49:14.648589+0000","last_clean":"2024-09-16T07:49:14.648589+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:49:14.648589+0000","last_undegraded":"2024-09-16T07:49:14.648589+0000","last_fullsized":"2024-09-16T07:49:14.648589+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"53'152","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.734761+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:49:14.734761+0000","last_peered":"2024-09-16T07:49:14.734761+0000","last_clean":"2024-09-16T07:49:14.734761+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:49:14.734761+0000","last_undegraded":"2024-09-16T07:49:14.734761+0000","last_fullsized":"2024-09-16T07:49:14.734761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"53'178","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.756229+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:49:14.756229+0000","last_peered":"2024-09-16T07:49:14.756229+0000","last_clean":"2024-09-16T07:49:14.756229+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:49:14.756229+0000","last_undegraded":"2024-09-16T07:49:14.756229+0000","last_fullsized":"2024-09-16T07:49:14.756229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458176,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"53'173","reported_seq":185,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.769614+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:49:14.769614+0000","last_peered":"2024-09-16T07:49:14.769614+0000","last_clean":"2024-09-16T07:49:14.769614+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:49:14.769614+0000","last_undegraded":"2024-09-16T07:49:14.769614+0000","last_fullsized":"2024-09-16T07:49:14.769614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1417216,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":1384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"53'160","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.405947+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:49:14.405947+0000","last_peered":"2024-09-16T07:49:14.405947+0000","last_clean":"2024-09-16T07:49:14.405947+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:49:14.405947+0000","last_undegraded":"2024-09-16T07:49:14.405947+0000","last_fullsized":"2024-09-16T07:49:14.405947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.259322+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:49:13.259322+0000","last_peered":"2024-09-16T07:49:13.259322+0000","last_clean":"2024-09-16T07:49:13.259322+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:49:13.259322+0000","last_undegraded":"2024-09-16T07:49:13.259322+0000","last_fullsized":"2024-09-16T07:49:13.259322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.112570+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:49:14.112570+0000","last_peered":"2024-09-16T07:49:14.112570+0000","last_clean":"2024-09-16T07:49:14.112570+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:49:14.112570+0000","last_undegraded":"2024-09-16T07:49:14.112570+0000","last_fullsized":"2024-09-16T07:49:14.112570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321373+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:48:57.321373+0000","last_peered":"2024-09-16T07:48:57.321373+0000","last_clean":"2024-09-16T07:48:57.321373+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:48:57.321373+0000","last_undegraded":"2024-09-16T07:48:57.321373+0000","last_fullsized":"2024-09-16T07:48:57.321373+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329687+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:48:57.329687+0000","last_peered":"2024-09-16T07:48:57.329687+0000","last_clean":"2024-09-16T07:48:57.329687+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:48:57.329687+0000","last_undegraded":"2024-09-16T07:48:57.329687+0000","last_fullsized":"2024-09-16T07:48:57.329687+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"53'312","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.299175+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:49:14.299175+0000","last_peered":"2024-09-16T07:49:14.299175+0000","last_clean":"2024-09-16T07:49:14.299175+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:49:14.299175+0000","last_undegraded":"2024-09-16T07:49:14.299175+0000","last_fullsized":"2024-09-16T07:49:14.299175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.323416+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:48:57.323416+0000","last_peered":"2024-09-16T07:48:57.323416+0000","last_clean":"2024-09-16T07:48:57.323416+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:48:57.323416+0000","last_undegraded":"2024-09-16T07:48:57.323416+0000","last_fullsized":"2024-09-16T07:48:57.323416+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.848416+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:49:13.848416+0000","last_peered":"2024-09-16T07:49:13.848416+0000","last_clean":"2024-09-16T07:49:13.848416+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:49:13.848416+0000","last_undegraded":"2024-09-16T07:49:13.848416+0000","last_fullsized":"2024-09-16T07:49:13.848416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.333161+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:48:57.333161+0000","last_peered":"2024-09-16T07:48:57.333161+0000","last_clean":"2024-09-16T07:48:57.333161+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:48:57.333161+0000","last_undegraded":"2024-09-16T07:48:57.333161+0000","last_fullsized":"2024-09-16T07:48:57.333161+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.606776+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:49:14.606776+0000","last_peered":"2024-09-16T07:49:14.606776+0000","last_clean":"2024-09-16T07:49:14.606776+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:49:14.606776+0000","last_undegraded":"2024-09-16T07:49:14.606776+0000","last_fullsized":"2024-09-16T07:49:14.606776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329507+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:48:57.329507+0000","last_peered":"2024-09-16T07:48:57.329507+0000","last_clean":"2024-09-16T07:48:57.329507+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:48:57.329507+0000","last_undegraded":"2024-09-16T07:48:57.329507+0000","last_fullsized":"2024-09-16T07:48:57.329507+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"53'264","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.888446+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:49:13.888446+0000","last_peered":"2024-09-16T07:49:13.888446+0000","last_clean":"2024-09-16T07:49:13.888446+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:49:13.888446+0000","last_undegraded":"2024-09-16T07:49:13.888446+0000","last_fullsized":"2024-09-16T07:49:13.888446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.330203+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:48:57.330203+0000","last_peered":"2024-09-16T07:48:57.330203+0000","last_clean":"2024-09-16T07:48:57.330203+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:48:57.330203+0000","last_undegraded":"2024-09-16T07:48:57.330203+0000","last_fullsized":"2024-09-16T07:48:57.330203+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"53'216","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.677606+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:49:14.677606+0000","last_peered":"2024-09-16T07:49:14.677606+0000","last_clean":"2024-09-16T07:49:14.677606+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:49:14.677606+0000","last_undegraded":"2024-09-16T07:49:14.677606+0000","last_fullsized":"2024-09-16T07:49:14.677606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.331131+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:48:57.331131+0000","last_peered":"2024-09-16T07:48:57.331131+0000","last_clean":"2024-09-16T07:48:57.331131+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:48:57.331131+0000","last_undegraded":"2024-09-16T07:48:57.331131+0000","last_fullsized":"2024-09-16T07:48:57.331131+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"53'208","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.544628+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:49:14.544628+0000","last_peered":"2024-09-16T07:49:14.544628+0000","last_clean":"2024-09-16T07:49:14.544628+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:49:14.544628+0000","last_undegraded":"2024-09-16T07:49:14.544628+0000","last_fullsized":"2024-09-16T07:49:14.544628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.322472+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:48:57.322472+0000","last_peered":"2024-09-16T07:48:57.322472+0000","last_clean":"2024-09-16T07:48:57.322472+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:48:57.322472+0000","last_undegraded":"2024-09-16T07:48:57.322472+0000","last_fullsized":"2024-09-16T07:48:57.322472+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"53'176","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.466193+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:49:13.466193+0000","last_peered":"2024-09-16T07:49:13.466193+0000","last_clean":"2024-09-16T07:49:13.466193+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:49:13.466193+0000","last_undegraded":"2024-09-16T07:49:13.466193+0000","last_fullsized":"2024-09-16T07:49:13.466193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321914+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:48:57.321914+0000","last_peered":"2024-09-16T07:48:57.321914+0000","last_clean":"2024-09-16T07:48:57.321914+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:48:57.321914+0000","last_undegraded":"2024-09-16T07:48:57.321914+0000","last_fullsized":"2024-09-16T07:48:57.321914+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":27189248,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3319,"num_write_kb":26552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40755200,"data_stored":81510400,"data_compressed":4205520,"data_compressed_allocated":40755200,"data_compressed_original":81510400,"omap_allocated":0,"internal_metadata":0},"log_size":3319,"ondisk_log_size":3319,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113928,"kb_used_data":10744,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94257912,"statfs":{"total":96636764160,"available":96520101888,"internally_reserved":0,"allocated":11001856,"data_stored":21243010,"data_compressed":1087589,"data_compressed_allocated":10539008,"data_compressed_original":21078016,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122540,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94249300,"statfs":{"total":96636764160,"available":96511283200,"internally_reserved":0,"allocated":11300864,"data_stored":22308514,"data_compressed":1141968,"data_compressed_allocated":10817536,"data_compressed_original":22126592,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88976,"kb_used_data":8000,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94282864,"statfs":{"total":96636764160,"available":96545652736,"internally_reserved":0,"allocated":8192000,"data_stored":16090786,"data_compressed":821269,"data_compressed_allocated":7708672,"data_compressed_original":15908864,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110124,"kb_used_data":11100,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94261716,"statfs":{"total":96636764160,"available":96523997184,"internally_reserved":0,"allocated":11366400,"data_stored":22447759,"data_compressed":1149207,"data_compressed_allocated":10887168,"data_compressed_original":22265856,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10956800,"data_stored":21913600,"data_compressed":1130591,"data_compressed_allocated":10956800,"data_compressed_original":21913600,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":15466496,"data_compressed":798000,"data_compressed_allocated":7733248,"data_compressed_original":15466496,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11436032,"data_stored":22872064,"data_compressed":1180034,"data_compressed_allocated":11436032,"data_compressed_original":22872064,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":21258240,"data_compressed":1096895,"data_compressed_allocated":10629120,"data_compressed_original":21258240,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:49:18.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 21 16 4004 3988 1.4835 1.25 0.0902515 0.0839423 2024-09-16T07:49:19.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 22 16 4183 4167 1.47962 1.39844 0.0779191 0.0843062 2024-09-16T07:49:20.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 23 16 4361 4345 1.47575 1.39062 0.0882158 0.0845853 2024-09-16T07:49:20.506 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:20.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:20.681+0000 7f5326874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:20.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:20.688+0000 7f5326874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:21.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 24 16 4552 4536 1.47642 1.49219 0.0705619 0.0845725 2024-09-16T07:49:22.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 25 16 4712 4696 1.46736 1.25 0.134622 0.0849635 2024-09-16T07:49:22.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:23.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:23.084+0000 7fda5b87f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:23.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:23.095+0000 7fda5b87f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:23.268 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:23.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:49:23.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 26 16 4900 4884 1.46741 1.46875 0.0418479 0.0851126 2024-09-16T07:49:23.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:23.390+0000 7f3dd6a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:23.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:23.404+0000 7f3dd6a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:23.868 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:49:23.887 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:49:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:24.047+0000 7f395f6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:24.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:24.065+0000 7f395e45b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:24.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 27 15 5065 5050 1.46109 1.29688 0.159283 0.0852959 2024-09-16T07:49:24.869 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:49:24.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:49:25.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:25.060+0000 7f8c5f888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:25.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:25.075+0000 7f8c5f888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:25.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:25.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 28 16 5242 5226 1.45801 1.375 0.0306322 0.0856062 2024-09-16T07:49:25.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:25.482+0000 7f718b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:25.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:25.490+0000 7f718b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:25.874 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:49:25.894 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:49:26.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:26.029+0000 7f100e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:26.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:26.042+0000 7f100e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:26.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 29 16 5414 5398 1.45406 1.34375 0.086984 0.0857809 2024-09-16T07:49:26.881 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:49:26.901 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:49:26.901 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:49:27.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:27.041+0000 7efe77b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:27.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:27.051+0000 7efe77b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:27.384 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:49:27.385 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:49:27.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 30 16 5590 5574 1.45143 1.375 0.0539642 0.0860134 2024-09-16T07:49:27.405 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-16T07:49:26.885524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27779635,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3400,"num_write_kb":27660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3374,"ondisk_log_size":3374,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":435568,"kb_used_data":40880,"kb_used_omap":0,"kb_used_meta":394624,"kb_avail":377051792,"statfs":{"total":386547056640,"available":386101035008,"internally_reserved":0,"allocated":41861120,"data_stored":82090069,"data_compressed":4200033,"data_compressed_allocated":39952384,"data_compressed_original":81379328,"omap_allocated":0,"internal_metadata":404094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.076420"},"pg_stats":[{"pgid":"8.7","version":"53'248","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.712056+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:49:13.712056+0000","last_peered":"2024-09-16T07:49:13.712056+0000","last_clean":"2024-09-16T07:49:13.712056+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:49:13.712056+0000","last_undegraded":"2024-09-16T07:49:13.712056+0000","last_fullsized":"2024-09-16T07:49:13.712056+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"53'144","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.109534+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:49:14.109534+0000","last_peered":"2024-09-16T07:49:14.109534+0000","last_clean":"2024-09-16T07:49:14.109534+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:49:14.109534+0000","last_undegraded":"2024-09-16T07:49:14.109534+0000","last_fullsized":"2024-09-16T07:49:14.109534+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"53'256","reported_seq":268,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.648589+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:49:14.648589+0000","last_peered":"2024-09-16T07:49:14.648589+0000","last_clean":"2024-09-16T07:49:14.648589+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:49:14.648589+0000","last_undegraded":"2024-09-16T07:49:14.648589+0000","last_fullsized":"2024-09-16T07:49:14.648589+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"53'152","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.734761+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:49:14.734761+0000","last_peered":"2024-09-16T07:49:14.734761+0000","last_clean":"2024-09-16T07:49:14.734761+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:49:14.734761+0000","last_undegraded":"2024-09-16T07:49:14.734761+0000","last_fullsized":"2024-09-16T07:49:14.734761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"53'178","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.756229+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:49:14.756229+0000","last_peered":"2024-09-16T07:49:14.756229+0000","last_clean":"2024-09-16T07:49:14.756229+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:49:14.756229+0000","last_undegraded":"2024-09-16T07:49:14.756229+0000","last_fullsized":"2024-09-16T07:49:14.756229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458176,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"53'173","reported_seq":185,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.769614+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:49:14.769614+0000","last_peered":"2024-09-16T07:49:14.769614+0000","last_clean":"2024-09-16T07:49:14.769614+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:49:14.769614+0000","last_undegraded":"2024-09-16T07:49:14.769614+0000","last_fullsized":"2024-09-16T07:49:14.769614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1417216,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":1384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"53'160","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.405947+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:49:14.405947+0000","last_peered":"2024-09-16T07:49:14.405947+0000","last_clean":"2024-09-16T07:49:14.405947+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:49:14.405947+0000","last_undegraded":"2024-09-16T07:49:14.405947+0000","last_fullsized":"2024-09-16T07:49:14.405947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.259322+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:49:13.259322+0000","last_peered":"2024-09-16T07:49:13.259322+0000","last_clean":"2024-09-16T07:49:13.259322+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:49:13.259322+0000","last_undegraded":"2024-09-16T07:49:13.259322+0000","last_fullsized":"2024-09-16T07:49:13.259322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.112570+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:49:14.112570+0000","last_peered":"2024-09-16T07:49:14.112570+0000","last_clean":"2024-09-16T07:49:14.112570+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:49:14.112570+0000","last_undegraded":"2024-09-16T07:49:14.112570+0000","last_fullsized":"2024-09-16T07:49:14.112570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321373+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:48:57.321373+0000","last_peered":"2024-09-16T07:48:57.321373+0000","last_clean":"2024-09-16T07:48:57.321373+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:48:57.321373+0000","last_undegraded":"2024-09-16T07:48:57.321373+0000","last_fullsized":"2024-09-16T07:48:57.321373+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329687+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:48:57.329687+0000","last_peered":"2024-09-16T07:48:57.329687+0000","last_clean":"2024-09-16T07:48:57.329687+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:48:57.329687+0000","last_undegraded":"2024-09-16T07:48:57.329687+0000","last_fullsized":"2024-09-16T07:48:57.329687+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"53'312","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.299175+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:49:14.299175+0000","last_peered":"2024-09-16T07:49:14.299175+0000","last_clean":"2024-09-16T07:49:14.299175+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:49:14.299175+0000","last_undegraded":"2024-09-16T07:49:14.299175+0000","last_fullsized":"2024-09-16T07:49:14.299175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.323416+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:48:57.323416+0000","last_peered":"2024-09-16T07:48:57.323416+0000","last_clean":"2024-09-16T07:48:57.323416+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:48:57.323416+0000","last_undegraded":"2024-09-16T07:48:57.323416+0000","last_fullsized":"2024-09-16T07:48:57.323416+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.848416+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:49:13.848416+0000","last_peered":"2024-09-16T07:49:13.848416+0000","last_clean":"2024-09-16T07:49:13.848416+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:49:13.848416+0000","last_undegraded":"2024-09-16T07:49:13.848416+0000","last_fullsized":"2024-09-16T07:49:13.848416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.333161+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:48:57.333161+0000","last_peered":"2024-09-16T07:48:57.333161+0000","last_clean":"2024-09-16T07:48:57.333161+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:48:57.333161+0000","last_undegraded":"2024-09-16T07:48:57.333161+0000","last_fullsized":"2024-09-16T07:48:57.333161+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.606776+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:49:14.606776+0000","last_peered":"2024-09-16T07:49:14.606776+0000","last_clean":"2024-09-16T07:49:14.606776+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:49:14.606776+0000","last_undegraded":"2024-09-16T07:49:14.606776+0000","last_fullsized":"2024-09-16T07:49:14.606776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329507+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:48:57.329507+0000","last_peered":"2024-09-16T07:48:57.329507+0000","last_clean":"2024-09-16T07:48:57.329507+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:48:57.329507+0000","last_undegraded":"2024-09-16T07:48:57.329507+0000","last_fullsized":"2024-09-16T07:48:57.329507+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"53'264","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.888446+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:49:13.888446+0000","last_peered":"2024-09-16T07:49:13.888446+0000","last_clean":"2024-09-16T07:49:13.888446+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:49:13.888446+0000","last_undegraded":"2024-09-16T07:49:13.888446+0000","last_fullsized":"2024-09-16T07:49:13.888446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.330203+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:48:57.330203+0000","last_peered":"2024-09-16T07:48:57.330203+0000","last_clean":"2024-09-16T07:48:57.330203+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:48:57.330203+0000","last_undegraded":"2024-09-16T07:48:57.330203+0000","last_fullsized":"2024-09-16T07:48:57.330203+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"53'216","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.677606+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:49:14.677606+0000","last_peered":"2024-09-16T07:49:14.677606+0000","last_clean":"2024-09-16T07:49:14.677606+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:49:14.677606+0000","last_undegraded":"2024-09-16T07:49:14.677606+0000","last_fullsized":"2024-09-16T07:49:14.677606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.331131+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:48:57.331131+0000","last_peered":"2024-09-16T07:48:57.331131+0000","last_clean":"2024-09-16T07:48:57.331131+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:48:57.331131+0000","last_undegraded":"2024-09-16T07:48:57.331131+0000","last_fullsized":"2024-09-16T07:48:57.331131+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"53'208","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.544628+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:49:14.544628+0000","last_peered":"2024-09-16T07:49:14.544628+0000","last_clean":"2024-09-16T07:49:14.544628+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:49:14.544628+0000","last_undegraded":"2024-09-16T07:49:14.544628+0000","last_fullsized":"2024-09-16T07:49:14.544628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.322472+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:48:57.322472+0000","last_peered":"2024-09-16T07:48:57.322472+0000","last_clean":"2024-09-16T07:48:57.322472+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:48:57.322472+0000","last_undegraded":"2024-09-16T07:48:57.322472+0000","last_fullsized":"2024-09-16T07:48:57.322472+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"53'176","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.466193+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:49:13.466193+0000","last_peered":"2024-09-16T07:49:13.466193+0000","last_clean":"2024-09-16T07:49:13.466193+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:49:13.466193+0000","last_undegraded":"2024-09-16T07:49:13.466193+0000","last_fullsized":"2024-09-16T07:49:13.466193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321914+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:48:57.321914+0000","last_peered":"2024-09-16T07:48:57.321914+0000","last_clean":"2024-09-16T07:48:57.321914+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:48:57.321914+0000","last_undegraded":"2024-09-16T07:48:57.321914+0000","last_fullsized":"2024-09-16T07:48:57.321914+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":27189248,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3319,"num_write_kb":26552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40755200,"data_stored":81510400,"data_compressed":4205520,"data_compressed_allocated":40755200,"data_compressed_original":81510400,"omap_allocated":0,"internal_metadata":0},"log_size":3319,"ondisk_log_size":3319,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113928,"kb_used_data":10744,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94257912,"statfs":{"total":96636764160,"available":96520101888,"internally_reserved":0,"allocated":11001856,"data_stored":21243010,"data_compressed":1087589,"data_compressed_allocated":10539008,"data_compressed_original":21078016,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122540,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94249300,"statfs":{"total":96636764160,"available":96511283200,"internally_reserved":0,"allocated":11300864,"data_stored":22308514,"data_compressed":1141968,"data_compressed_allocated":10817536,"data_compressed_original":22126592,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88976,"kb_used_data":8000,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94282864,"statfs":{"total":96636764160,"available":96545652736,"internally_reserved":0,"allocated":8192000,"data_stored":16090786,"data_compressed":821269,"data_compressed_allocated":7708672,"data_compressed_original":15908864,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110124,"kb_used_data":11100,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94261716,"statfs":{"total":96636764160,"available":96523997184,"internally_reserved":0,"allocated":11366400,"data_stored":22447759,"data_compressed":1149207,"data_compressed_allocated":10887168,"data_compressed_original":22265856,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10956800,"data_stored":21913600,"data_compressed":1130591,"data_compressed_allocated":10956800,"data_compressed_original":21913600,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":15466496,"data_compressed":798000,"data_compressed_allocated":7733248,"data_compressed_original":15466496,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11436032,"data_stored":22872064,"data_compressed":1180034,"data_compressed_allocated":11436032,"data_compressed_original":22872064,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":21258240,"data_compressed":1096895,"data_compressed_allocated":10629120,"data_compressed_original":21258240,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:49:27.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:49:27.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:27.565+0000 7f3f45111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:27.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:27.573+0000 7f3f45111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:27.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:27.891 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:49:27.891 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:49:27.916 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-16T07:49:27.810270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27779635,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3400,"num_write_kb":27660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3374,"ondisk_log_size":3374,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":435568,"kb_used_data":40880,"kb_used_omap":0,"kb_used_meta":394624,"kb_avail":377051792,"statfs":{"total":386547056640,"available":386101035008,"internally_reserved":0,"allocated":41861120,"data_stored":82090069,"data_compressed":4200033,"data_compressed_allocated":39952384,"data_compressed_original":81379328,"omap_allocated":0,"internal_metadata":404094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000741"},"pg_stats":[{"pgid":"8.7","version":"53'248","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.712056+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:49:13.712056+0000","last_peered":"2024-09-16T07:49:13.712056+0000","last_clean":"2024-09-16T07:49:13.712056+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:49:13.712056+0000","last_undegraded":"2024-09-16T07:49:13.712056+0000","last_fullsized":"2024-09-16T07:49:13.712056+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"53'144","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.109534+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:49:14.109534+0000","last_peered":"2024-09-16T07:49:14.109534+0000","last_clean":"2024-09-16T07:49:14.109534+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:49:14.109534+0000","last_undegraded":"2024-09-16T07:49:14.109534+0000","last_fullsized":"2024-09-16T07:49:14.109534+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"53'256","reported_seq":268,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.648589+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:49:14.648589+0000","last_peered":"2024-09-16T07:49:14.648589+0000","last_clean":"2024-09-16T07:49:14.648589+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:49:14.648589+0000","last_undegraded":"2024-09-16T07:49:14.648589+0000","last_fullsized":"2024-09-16T07:49:14.648589+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"53'152","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.734761+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:49:14.734761+0000","last_peered":"2024-09-16T07:49:14.734761+0000","last_clean":"2024-09-16T07:49:14.734761+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:49:14.734761+0000","last_undegraded":"2024-09-16T07:49:14.734761+0000","last_fullsized":"2024-09-16T07:49:14.734761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"53'178","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.756229+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:49:14.756229+0000","last_peered":"2024-09-16T07:49:14.756229+0000","last_clean":"2024-09-16T07:49:14.756229+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:49:14.756229+0000","last_undegraded":"2024-09-16T07:49:14.756229+0000","last_fullsized":"2024-09-16T07:49:14.756229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458176,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"53'173","reported_seq":185,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.769614+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:49:14.769614+0000","last_peered":"2024-09-16T07:49:14.769614+0000","last_clean":"2024-09-16T07:49:14.769614+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:49:14.769614+0000","last_undegraded":"2024-09-16T07:49:14.769614+0000","last_fullsized":"2024-09-16T07:49:14.769614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1417216,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":1384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"53'160","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.405947+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:49:14.405947+0000","last_peered":"2024-09-16T07:49:14.405947+0000","last_clean":"2024-09-16T07:49:14.405947+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:49:14.405947+0000","last_undegraded":"2024-09-16T07:49:14.405947+0000","last_fullsized":"2024-09-16T07:49:14.405947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.259322+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:49:13.259322+0000","last_peered":"2024-09-16T07:49:13.259322+0000","last_clean":"2024-09-16T07:49:13.259322+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:49:13.259322+0000","last_undegraded":"2024-09-16T07:49:13.259322+0000","last_fullsized":"2024-09-16T07:49:13.259322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.112570+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:49:14.112570+0000","last_peered":"2024-09-16T07:49:14.112570+0000","last_clean":"2024-09-16T07:49:14.112570+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:49:14.112570+0000","last_undegraded":"2024-09-16T07:49:14.112570+0000","last_fullsized":"2024-09-16T07:49:14.112570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321373+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:48:57.321373+0000","last_peered":"2024-09-16T07:48:57.321373+0000","last_clean":"2024-09-16T07:48:57.321373+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:48:57.321373+0000","last_undegraded":"2024-09-16T07:48:57.321373+0000","last_fullsized":"2024-09-16T07:48:57.321373+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329687+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:48:57.329687+0000","last_peered":"2024-09-16T07:48:57.329687+0000","last_clean":"2024-09-16T07:48:57.329687+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:48:57.329687+0000","last_undegraded":"2024-09-16T07:48:57.329687+0000","last_fullsized":"2024-09-16T07:48:57.329687+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"53'312","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.299175+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:49:14.299175+0000","last_peered":"2024-09-16T07:49:14.299175+0000","last_clean":"2024-09-16T07:49:14.299175+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:49:14.299175+0000","last_undegraded":"2024-09-16T07:49:14.299175+0000","last_fullsized":"2024-09-16T07:49:14.299175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.323416+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:48:57.323416+0000","last_peered":"2024-09-16T07:48:57.323416+0000","last_clean":"2024-09-16T07:48:57.323416+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:48:57.323416+0000","last_undegraded":"2024-09-16T07:48:57.323416+0000","last_fullsized":"2024-09-16T07:48:57.323416+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.848416+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:49:13.848416+0000","last_peered":"2024-09-16T07:49:13.848416+0000","last_clean":"2024-09-16T07:49:13.848416+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:49:13.848416+0000","last_undegraded":"2024-09-16T07:49:13.848416+0000","last_fullsized":"2024-09-16T07:49:13.848416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.333161+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:48:57.333161+0000","last_peered":"2024-09-16T07:48:57.333161+0000","last_clean":"2024-09-16T07:48:57.333161+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:48:57.333161+0000","last_undegraded":"2024-09-16T07:48:57.333161+0000","last_fullsized":"2024-09-16T07:48:57.333161+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.606776+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:49:14.606776+0000","last_peered":"2024-09-16T07:49:14.606776+0000","last_clean":"2024-09-16T07:49:14.606776+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:49:14.606776+0000","last_undegraded":"2024-09-16T07:49:14.606776+0000","last_fullsized":"2024-09-16T07:49:14.606776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329507+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:48:57.329507+0000","last_peered":"2024-09-16T07:48:57.329507+0000","last_clean":"2024-09-16T07:48:57.329507+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:48:57.329507+0000","last_undegraded":"2024-09-16T07:48:57.329507+0000","last_fullsized":"2024-09-16T07:48:57.329507+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"53'264","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.888446+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:49:13.888446+0000","last_peered":"2024-09-16T07:49:13.888446+0000","last_clean":"2024-09-16T07:49:13.888446+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:49:13.888446+0000","last_undegraded":"2024-09-16T07:49:13.888446+0000","last_fullsized":"2024-09-16T07:49:13.888446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.330203+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:48:57.330203+0000","last_peered":"2024-09-16T07:48:57.330203+0000","last_clean":"2024-09-16T07:48:57.330203+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:48:57.330203+0000","last_undegraded":"2024-09-16T07:48:57.330203+0000","last_fullsized":"2024-09-16T07:48:57.330203+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"53'216","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.677606+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:49:14.677606+0000","last_peered":"2024-09-16T07:49:14.677606+0000","last_clean":"2024-09-16T07:49:14.677606+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:49:14.677606+0000","last_undegraded":"2024-09-16T07:49:14.677606+0000","last_fullsized":"2024-09-16T07:49:14.677606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.331131+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:48:57.331131+0000","last_peered":"2024-09-16T07:48:57.331131+0000","last_clean":"2024-09-16T07:48:57.331131+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:48:57.331131+0000","last_undegraded":"2024-09-16T07:48:57.331131+0000","last_fullsized":"2024-09-16T07:48:57.331131+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"53'208","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.544628+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:49:14.544628+0000","last_peered":"2024-09-16T07:49:14.544628+0000","last_clean":"2024-09-16T07:49:14.544628+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:49:14.544628+0000","last_undegraded":"2024-09-16T07:49:14.544628+0000","last_fullsized":"2024-09-16T07:49:14.544628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.322472+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:48:57.322472+0000","last_peered":"2024-09-16T07:48:57.322472+0000","last_clean":"2024-09-16T07:48:57.322472+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:48:57.322472+0000","last_undegraded":"2024-09-16T07:48:57.322472+0000","last_fullsized":"2024-09-16T07:48:57.322472+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"53'176","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.466193+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:49:13.466193+0000","last_peered":"2024-09-16T07:49:13.466193+0000","last_clean":"2024-09-16T07:49:13.466193+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:49:13.466193+0000","last_undegraded":"2024-09-16T07:49:13.466193+0000","last_fullsized":"2024-09-16T07:49:13.466193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321914+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:48:57.321914+0000","last_peered":"2024-09-16T07:48:57.321914+0000","last_clean":"2024-09-16T07:48:57.321914+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:48:57.321914+0000","last_undegraded":"2024-09-16T07:48:57.321914+0000","last_fullsized":"2024-09-16T07:48:57.321914+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":27189248,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3319,"num_write_kb":26552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40755200,"data_stored":81510400,"data_compressed":4205520,"data_compressed_allocated":40755200,"data_compressed_original":81510400,"omap_allocated":0,"internal_metadata":0},"log_size":3319,"ondisk_log_size":3319,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113928,"kb_used_data":10744,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94257912,"statfs":{"total":96636764160,"available":96520101888,"internally_reserved":0,"allocated":11001856,"data_stored":21243010,"data_compressed":1087589,"data_compressed_allocated":10539008,"data_compressed_original":21078016,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122540,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94249300,"statfs":{"total":96636764160,"available":96511283200,"internally_reserved":0,"allocated":11300864,"data_stored":22308514,"data_compressed":1141968,"data_compressed_allocated":10817536,"data_compressed_original":22126592,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88976,"kb_used_data":8000,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94282864,"statfs":{"total":96636764160,"available":96545652736,"internally_reserved":0,"allocated":8192000,"data_stored":16090786,"data_compressed":821269,"data_compressed_allocated":7708672,"data_compressed_original":15908864,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110124,"kb_used_data":11100,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94261716,"statfs":{"total":96636764160,"available":96523997184,"internally_reserved":0,"allocated":11366400,"data_stored":22447759,"data_compressed":1149207,"data_compressed_allocated":10887168,"data_compressed_original":22265856,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10956800,"data_stored":21913600,"data_compressed":1130591,"data_compressed_allocated":10956800,"data_compressed_original":21913600,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":15466496,"data_compressed":798000,"data_compressed_allocated":7733248,"data_compressed_original":15466496,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11436032,"data_stored":22872064,"data_compressed":1180034,"data_compressed_allocated":11436032,"data_compressed_original":22872064,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":21258240,"data_compressed":1096895,"data_compressed_allocated":10629120,"data_compressed_original":21258240,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:49:27.918 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:49:27.918 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:27.918 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:49:27.918 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:49:27.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:27.944+0000 7f4cab791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:27.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:27.956+0000 7f4cab791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:28.067+0000 7faf18551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:28.080+0000 7faf18551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:28.127 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:28.128 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:28.131 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:28.132 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:28.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:49:28.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:28.328+0000 7fd3c7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:28.347+0000 7fd3c7591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.371 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:28.371 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:28.371 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:28.371 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:28.372 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:28.372 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:28.372 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:28.372 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:28.372 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:28.372 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:28.372 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:28.372 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:28.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:28.375 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:28.375 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:49:28.396 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 31 16 5768 5752 1.44946 1.39062 0.0561089 0.0861425 2024-09-16T07:49:28.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:28.538+0000 7f53e746c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:28.551+0000 7f53e746c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:28.589 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:28.590 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:28.590 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:28.590 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:28.593 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:28.593 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:28.593 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:49:28.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:28.782+0000 7f9fe087f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:28.794+0000 7f9fe087f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:28.900 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:28.900 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:28.900 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:28.900 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:28.900 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:28.901 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:28.901 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:28.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:28.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:28.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:28.901 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:28.901 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:28.904 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:28.904 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:29.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 32 16 5927 5911 1.44298 1.24219 0.108472 0.0864489 2024-09-16T07:49:30.151 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:30.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:30.316+0000 7fa04a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:30.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:30.326+0000 7fa04a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:30.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 33 16 6100 6084 1.44021 1.35156 0.0655308 0.0867062 2024-09-16T07:49:31.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 34 16 6262 6246 1.43507 1.26562 0.118762 0.0869327 2024-09-16T07:49:32.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 35 16 6435 6419 1.43268 1.35156 0.0463935 0.0871651 2024-09-16T07:49:32.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:32.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:32.728+0000 7f26970b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:32.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:32.734+0000 7f26970b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:33.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 36 16 6596 6580 1.42782 1.25781 0.0601023 0.087419 2024-09-16T07:49:33.905 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:33.905 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:33.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:49:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:34.046+0000 7f943b674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:34.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:34.059+0000 7f943b674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:34.316 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:49:34.317 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:49:34.336 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-09-16T07:49:33.811330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27779635,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3400,"num_write_kb":27660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3374,"ondisk_log_size":3374,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":435568,"kb_used_data":40880,"kb_used_omap":0,"kb_used_meta":394624,"kb_avail":377051792,"statfs":{"total":386547056640,"available":386101035008,"internally_reserved":0,"allocated":41861120,"data_stored":82090069,"data_compressed":4200033,"data_compressed_allocated":39952384,"data_compressed_original":81379328,"omap_allocated":0,"internal_metadata":404094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001420"},"pg_stats":[{"pgid":"8.7","version":"53'248","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.712056+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:49:13.712056+0000","last_peered":"2024-09-16T07:49:13.712056+0000","last_clean":"2024-09-16T07:49:13.712056+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:49:13.712056+0000","last_undegraded":"2024-09-16T07:49:13.712056+0000","last_fullsized":"2024-09-16T07:49:13.712056+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"53'144","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.109534+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:49:14.109534+0000","last_peered":"2024-09-16T07:49:14.109534+0000","last_clean":"2024-09-16T07:49:14.109534+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:49:14.109534+0000","last_undegraded":"2024-09-16T07:49:14.109534+0000","last_fullsized":"2024-09-16T07:49:14.109534+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"53'256","reported_seq":268,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.648589+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:49:14.648589+0000","last_peered":"2024-09-16T07:49:14.648589+0000","last_clean":"2024-09-16T07:49:14.648589+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:49:14.648589+0000","last_undegraded":"2024-09-16T07:49:14.648589+0000","last_fullsized":"2024-09-16T07:49:14.648589+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"53'152","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.734761+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:49:14.734761+0000","last_peered":"2024-09-16T07:49:14.734761+0000","last_clean":"2024-09-16T07:49:14.734761+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:49:14.734761+0000","last_undegraded":"2024-09-16T07:49:14.734761+0000","last_fullsized":"2024-09-16T07:49:14.734761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"53'178","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.756229+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:49:14.756229+0000","last_peered":"2024-09-16T07:49:14.756229+0000","last_clean":"2024-09-16T07:49:14.756229+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:49:14.756229+0000","last_undegraded":"2024-09-16T07:49:14.756229+0000","last_fullsized":"2024-09-16T07:49:14.756229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458176,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"53'173","reported_seq":185,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.769614+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:49:14.769614+0000","last_peered":"2024-09-16T07:49:14.769614+0000","last_clean":"2024-09-16T07:49:14.769614+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:49:14.769614+0000","last_undegraded":"2024-09-16T07:49:14.769614+0000","last_fullsized":"2024-09-16T07:49:14.769614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1417216,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":1384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"53'160","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.405947+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:49:14.405947+0000","last_peered":"2024-09-16T07:49:14.405947+0000","last_clean":"2024-09-16T07:49:14.405947+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:49:14.405947+0000","last_undegraded":"2024-09-16T07:49:14.405947+0000","last_fullsized":"2024-09-16T07:49:14.405947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.259322+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:49:13.259322+0000","last_peered":"2024-09-16T07:49:13.259322+0000","last_clean":"2024-09-16T07:49:13.259322+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:49:13.259322+0000","last_undegraded":"2024-09-16T07:49:13.259322+0000","last_fullsized":"2024-09-16T07:49:13.259322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.112570+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:49:14.112570+0000","last_peered":"2024-09-16T07:49:14.112570+0000","last_clean":"2024-09-16T07:49:14.112570+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:49:14.112570+0000","last_undegraded":"2024-09-16T07:49:14.112570+0000","last_fullsized":"2024-09-16T07:49:14.112570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321373+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:48:57.321373+0000","last_peered":"2024-09-16T07:48:57.321373+0000","last_clean":"2024-09-16T07:48:57.321373+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:48:57.321373+0000","last_undegraded":"2024-09-16T07:48:57.321373+0000","last_fullsized":"2024-09-16T07:48:57.321373+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329687+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:48:57.329687+0000","last_peered":"2024-09-16T07:48:57.329687+0000","last_clean":"2024-09-16T07:48:57.329687+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:48:57.329687+0000","last_undegraded":"2024-09-16T07:48:57.329687+0000","last_fullsized":"2024-09-16T07:48:57.329687+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"53'312","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.299175+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:49:14.299175+0000","last_peered":"2024-09-16T07:49:14.299175+0000","last_clean":"2024-09-16T07:49:14.299175+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:49:14.299175+0000","last_undegraded":"2024-09-16T07:49:14.299175+0000","last_fullsized":"2024-09-16T07:49:14.299175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.323416+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:48:57.323416+0000","last_peered":"2024-09-16T07:48:57.323416+0000","last_clean":"2024-09-16T07:48:57.323416+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:48:57.323416+0000","last_undegraded":"2024-09-16T07:48:57.323416+0000","last_fullsized":"2024-09-16T07:48:57.323416+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.848416+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:49:13.848416+0000","last_peered":"2024-09-16T07:49:13.848416+0000","last_clean":"2024-09-16T07:49:13.848416+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:49:13.848416+0000","last_undegraded":"2024-09-16T07:49:13.848416+0000","last_fullsized":"2024-09-16T07:49:13.848416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.333161+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:48:57.333161+0000","last_peered":"2024-09-16T07:48:57.333161+0000","last_clean":"2024-09-16T07:48:57.333161+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:48:57.333161+0000","last_undegraded":"2024-09-16T07:48:57.333161+0000","last_fullsized":"2024-09-16T07:48:57.333161+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.606776+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:49:14.606776+0000","last_peered":"2024-09-16T07:49:14.606776+0000","last_clean":"2024-09-16T07:49:14.606776+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:49:14.606776+0000","last_undegraded":"2024-09-16T07:49:14.606776+0000","last_fullsized":"2024-09-16T07:49:14.606776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329507+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:48:57.329507+0000","last_peered":"2024-09-16T07:48:57.329507+0000","last_clean":"2024-09-16T07:48:57.329507+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:48:57.329507+0000","last_undegraded":"2024-09-16T07:48:57.329507+0000","last_fullsized":"2024-09-16T07:48:57.329507+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"53'264","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.888446+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:49:13.888446+0000","last_peered":"2024-09-16T07:49:13.888446+0000","last_clean":"2024-09-16T07:49:13.888446+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:49:13.888446+0000","last_undegraded":"2024-09-16T07:49:13.888446+0000","last_fullsized":"2024-09-16T07:49:13.888446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.330203+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:48:57.330203+0000","last_peered":"2024-09-16T07:48:57.330203+0000","last_clean":"2024-09-16T07:48:57.330203+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:48:57.330203+0000","last_undegraded":"2024-09-16T07:48:57.330203+0000","last_fullsized":"2024-09-16T07:48:57.330203+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"53'216","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.677606+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:49:14.677606+0000","last_peered":"2024-09-16T07:49:14.677606+0000","last_clean":"2024-09-16T07:49:14.677606+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:49:14.677606+0000","last_undegraded":"2024-09-16T07:49:14.677606+0000","last_fullsized":"2024-09-16T07:49:14.677606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.331131+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:48:57.331131+0000","last_peered":"2024-09-16T07:48:57.331131+0000","last_clean":"2024-09-16T07:48:57.331131+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:48:57.331131+0000","last_undegraded":"2024-09-16T07:48:57.331131+0000","last_fullsized":"2024-09-16T07:48:57.331131+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"53'208","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.544628+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:49:14.544628+0000","last_peered":"2024-09-16T07:49:14.544628+0000","last_clean":"2024-09-16T07:49:14.544628+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:49:14.544628+0000","last_undegraded":"2024-09-16T07:49:14.544628+0000","last_fullsized":"2024-09-16T07:49:14.544628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.322472+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:48:57.322472+0000","last_peered":"2024-09-16T07:48:57.322472+0000","last_clean":"2024-09-16T07:48:57.322472+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:48:57.322472+0000","last_undegraded":"2024-09-16T07:48:57.322472+0000","last_fullsized":"2024-09-16T07:48:57.322472+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"53'176","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.466193+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:49:13.466193+0000","last_peered":"2024-09-16T07:49:13.466193+0000","last_clean":"2024-09-16T07:49:13.466193+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:49:13.466193+0000","last_undegraded":"2024-09-16T07:49:13.466193+0000","last_fullsized":"2024-09-16T07:49:13.466193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321914+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:48:57.321914+0000","last_peered":"2024-09-16T07:48:57.321914+0000","last_clean":"2024-09-16T07:48:57.321914+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:48:57.321914+0000","last_undegraded":"2024-09-16T07:48:57.321914+0000","last_fullsized":"2024-09-16T07:48:57.321914+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":27189248,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3319,"num_write_kb":26552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40755200,"data_stored":81510400,"data_compressed":4205520,"data_compressed_allocated":40755200,"data_compressed_original":81510400,"omap_allocated":0,"internal_metadata":0},"log_size":3319,"ondisk_log_size":3319,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113928,"kb_used_data":10744,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94257912,"statfs":{"total":96636764160,"available":96520101888,"internally_reserved":0,"allocated":11001856,"data_stored":21243010,"data_compressed":1087589,"data_compressed_allocated":10539008,"data_compressed_original":21078016,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122540,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94249300,"statfs":{"total":96636764160,"available":96511283200,"internally_reserved":0,"allocated":11300864,"data_stored":22308514,"data_compressed":1141968,"data_compressed_allocated":10817536,"data_compressed_original":22126592,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88976,"kb_used_data":8000,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94282864,"statfs":{"total":96636764160,"available":96545652736,"internally_reserved":0,"allocated":8192000,"data_stored":16090786,"data_compressed":821269,"data_compressed_allocated":7708672,"data_compressed_original":15908864,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110124,"kb_used_data":11100,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94261716,"statfs":{"total":96636764160,"available":96523997184,"internally_reserved":0,"allocated":11366400,"data_stored":22447759,"data_compressed":1149207,"data_compressed_allocated":10887168,"data_compressed_original":22265856,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10956800,"data_stored":21913600,"data_compressed":1130591,"data_compressed_allocated":10956800,"data_compressed_original":21913600,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":15466496,"data_compressed":798000,"data_compressed_allocated":7733248,"data_compressed_original":15466496,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11436032,"data_stored":22872064,"data_compressed":1180034,"data_compressed_allocated":11436032,"data_compressed_original":22872064,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":21258240,"data_compressed":1096895,"data_compressed_allocated":10629120,"data_compressed_original":21258240,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:49:34.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 37 16 6774 6758 1.42681 1.39062 0.0586428 0.0874966 2024-09-16T07:49:35.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:35.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:35.341+0000 7ffafcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:35.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:35.348+0000 7ffafcd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:35.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 38 16 6931 6915 1.42154 1.22656 0.0405203 0.0878437 2024-09-16T07:49:36.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 39 16 7109 7093 1.42074 1.39062 0.0868237 0.0878524 2024-09-16T07:49:37.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:49:37.399275+0000 min lat: 0.0188934 max lat: 0.234927 avg lat: 0.0880946 2024-09-16T07:49:37.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:49:37.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 40 16 7273 7257 1.41725 1.28125 0.144065 0.0880946 2024-09-16T07:49:37.580 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:37.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:37.736+0000 7f1a50191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:37.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:37.744+0000 7f1a50191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:38.397 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 41 16 7461 7445 1.4185 1.46875 0.10251 0.0880357 2024-09-16T07:49:39.338 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:39.338 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:39.338 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:49:39.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 42 16 7643 7627 1.41858 1.42188 0.0751073 0.0879785 2024-09-16T07:49:39.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:39.492+0000 7fcc27191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:39.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:39.502+0000 7fcc27191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:39.796 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:49:39.797 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:49:39.822 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-09-16T07:49:37.812106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27779635,"num_objects":420,"num_object_clones":0,"num_object_copies":1260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3400,"num_write_kb":27660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3374,"ondisk_log_size":3374,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":435568,"kb_used_data":40880,"kb_used_omap":0,"kb_used_meta":394624,"kb_avail":377051792,"statfs":{"total":386547056640,"available":386101035008,"internally_reserved":0,"allocated":41861120,"data_stored":82090069,"data_compressed":4200033,"data_compressed_allocated":39952384,"data_compressed_original":81379328,"omap_allocated":0,"internal_metadata":404094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.926581"},"pg_stats":[{"pgid":"8.7","version":"53'248","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.712056+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:49:13.712056+0000","last_peered":"2024-09-16T07:49:13.712056+0000","last_clean":"2024-09-16T07:49:13.712056+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:49:13.712056+0000","last_undegraded":"2024-09-16T07:49:13.712056+0000","last_fullsized":"2024-09-16T07:49:13.712056+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2031616,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"53'144","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.109534+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:49:14.109534+0000","last_peered":"2024-09-16T07:49:14.109534+0000","last_clean":"2024-09-16T07:49:14.109534+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:49:14.109534+0000","last_undegraded":"2024-09-16T07:49:14.109534+0000","last_fullsized":"2024-09-16T07:49:14.109534+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"53'256","reported_seq":268,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.648589+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:49:14.648589+0000","last_peered":"2024-09-16T07:49:14.648589+0000","last_clean":"2024-09-16T07:49:14.648589+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:49:14.648589+0000","last_undegraded":"2024-09-16T07:49:14.648589+0000","last_fullsized":"2024-09-16T07:49:14.648589+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":256,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"53'152","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.734761+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:49:14.734761+0000","last_peered":"2024-09-16T07:49:14.734761+0000","last_clean":"2024-09-16T07:49:14.734761+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:49:14.734761+0000","last_undegraded":"2024-09-16T07:49:14.734761+0000","last_fullsized":"2024-09-16T07:49:14.734761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"53'178","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.756229+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:49:14.756229+0000","last_peered":"2024-09-16T07:49:14.756229+0000","last_clean":"2024-09-16T07:49:14.756229+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:49:14.756229+0000","last_undegraded":"2024-09-16T07:49:14.756229+0000","last_fullsized":"2024-09-16T07:49:14.756229+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458176,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"53'173","reported_seq":185,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.769614+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:49:14.769614+0000","last_peered":"2024-09-16T07:49:14.769614+0000","last_clean":"2024-09-16T07:49:14.769614+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:49:14.769614+0000","last_undegraded":"2024-09-16T07:49:14.769614+0000","last_fullsized":"2024-09-16T07:49:14.769614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1417216,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":1384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"53'160","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.405947+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:49:14.405947+0000","last_peered":"2024-09-16T07:49:14.405947+0000","last_clean":"2024-09-16T07:49:14.405947+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:49:14.405947+0000","last_undegraded":"2024-09-16T07:49:14.405947+0000","last_fullsized":"2024-09-16T07:49:14.405947+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.259322+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:49:13.259322+0000","last_peered":"2024-09-16T07:49:13.259322+0000","last_clean":"2024-09-16T07:49:13.259322+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:49:13.259322+0000","last_undegraded":"2024-09-16T07:49:13.259322+0000","last_fullsized":"2024-09-16T07:49:13.259322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.112570+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:49:14.112570+0000","last_peered":"2024-09-16T07:49:14.112570+0000","last_clean":"2024-09-16T07:49:14.112570+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:49:14.112570+0000","last_undegraded":"2024-09-16T07:49:14.112570+0000","last_fullsized":"2024-09-16T07:49:14.112570+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321373+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:48:57.321373+0000","last_peered":"2024-09-16T07:48:57.321373+0000","last_clean":"2024-09-16T07:48:57.321373+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:48:57.321373+0000","last_undegraded":"2024-09-16T07:48:57.321373+0000","last_fullsized":"2024-09-16T07:48:57.321373+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329687+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:48:57.329687+0000","last_peered":"2024-09-16T07:48:57.329687+0000","last_clean":"2024-09-16T07:48:57.329687+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:48:57.329687+0000","last_undegraded":"2024-09-16T07:48:57.329687+0000","last_fullsized":"2024-09-16T07:48:57.329687+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"53'312","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.299175+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:49:14.299175+0000","last_peered":"2024-09-16T07:49:14.299175+0000","last_clean":"2024-09-16T07:49:14.299175+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:49:14.299175+0000","last_undegraded":"2024-09-16T07:49:14.299175+0000","last_fullsized":"2024-09-16T07:49:14.299175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.323416+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:48:57.323416+0000","last_peered":"2024-09-16T07:48:57.323416+0000","last_clean":"2024-09-16T07:48:57.323416+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:48:57.323416+0000","last_undegraded":"2024-09-16T07:48:57.323416+0000","last_fullsized":"2024-09-16T07:48:57.323416+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"53'184","reported_seq":196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.848416+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:49:13.848416+0000","last_peered":"2024-09-16T07:49:13.848416+0000","last_clean":"2024-09-16T07:49:13.848416+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:49:13.848416+0000","last_undegraded":"2024-09-16T07:49:13.848416+0000","last_fullsized":"2024-09-16T07:49:13.848416+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":184,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.333161+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:48:57.333161+0000","last_peered":"2024-09-16T07:48:57.333161+0000","last_clean":"2024-09-16T07:48:57.333161+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:48:57.333161+0000","last_undegraded":"2024-09-16T07:48:57.333161+0000","last_fullsized":"2024-09-16T07:48:57.333161+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"53'232","reported_seq":244,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.606776+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:49:14.606776+0000","last_peered":"2024-09-16T07:49:14.606776+0000","last_clean":"2024-09-16T07:49:14.606776+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:49:14.606776+0000","last_undegraded":"2024-09-16T07:49:14.606776+0000","last_fullsized":"2024-09-16T07:49:14.606776+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900544,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":232,"num_write_kb":1856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.329507+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:48:57.329507+0000","last_peered":"2024-09-16T07:48:57.329507+0000","last_clean":"2024-09-16T07:48:57.329507+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:48:57.329507+0000","last_undegraded":"2024-09-16T07:48:57.329507+0000","last_fullsized":"2024-09-16T07:48:57.329507+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"53'264","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.888446+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:49:13.888446+0000","last_peered":"2024-09-16T07:49:13.888446+0000","last_clean":"2024-09-16T07:49:13.888446+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:49:13.888446+0000","last_undegraded":"2024-09-16T07:49:13.888446+0000","last_fullsized":"2024-09-16T07:49:13.888446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162688,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":2112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.330203+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:48:57.330203+0000","last_peered":"2024-09-16T07:48:57.330203+0000","last_clean":"2024-09-16T07:48:57.330203+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:48:57.330203+0000","last_undegraded":"2024-09-16T07:48:57.330203+0000","last_fullsized":"2024-09-16T07:48:57.330203+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"53'216","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.677606+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:49:14.677606+0000","last_peered":"2024-09-16T07:49:14.677606+0000","last_clean":"2024-09-16T07:49:14.677606+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:49:14.677606+0000","last_undegraded":"2024-09-16T07:49:14.677606+0000","last_fullsized":"2024-09-16T07:49:14.677606+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1769472,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":216,"num_write_kb":1728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.331131+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:48:57.331131+0000","last_peered":"2024-09-16T07:48:57.331131+0000","last_clean":"2024-09-16T07:48:57.331131+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:48:57.331131+0000","last_undegraded":"2024-09-16T07:48:57.331131+0000","last_fullsized":"2024-09-16T07:48:57.331131+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"53'208","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:14.544628+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:49:14.544628+0000","last_peered":"2024-09-16T07:49:14.544628+0000","last_clean":"2024-09-16T07:49:14.544628+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:49:14.544628+0000","last_undegraded":"2024-09-16T07:49:14.544628+0000","last_fullsized":"2024-09-16T07:49:14.544628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":208,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.322472+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:48:57.322472+0000","last_peered":"2024-09-16T07:48:57.322472+0000","last_clean":"2024-09-16T07:48:57.322472+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:48:57.322472+0000","last_undegraded":"2024-09-16T07:48:57.322472+0000","last_fullsized":"2024-09-16T07:48:57.322472+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"53'176","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:49:13.466193+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:49:13.466193+0000","last_peered":"2024-09-16T07:49:13.466193+0000","last_clean":"2024-09-16T07:49:13.466193+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:49:13.466193+0000","last_undegraded":"2024-09-16T07:49:13.466193+0000","last_fullsized":"2024-09-16T07:49:13.466193+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-16T07:48:57.321914+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:48:57.321914+0000","last_peered":"2024-09-16T07:48:57.321914+0000","last_clean":"2024-09-16T07:48:57.321914+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:48:57.321914+0000","last_undegraded":"2024-09-16T07:48:57.321914+0000","last_fullsized":"2024-09-16T07:48:57.321914+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":27189248,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3319,"num_write_kb":26552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40755200,"data_stored":81510400,"data_compressed":4205520,"data_compressed_allocated":40755200,"data_compressed_original":81510400,"omap_allocated":0,"internal_metadata":0},"log_size":3319,"ondisk_log_size":3319,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":113928,"kb_used_data":10744,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94257912,"statfs":{"total":96636764160,"available":96520101888,"internally_reserved":0,"allocated":11001856,"data_stored":21243010,"data_compressed":1087589,"data_compressed_allocated":10539008,"data_compressed_original":21078016,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122540,"kb_used_data":11036,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94249300,"statfs":{"total":96636764160,"available":96511283200,"internally_reserved":0,"allocated":11300864,"data_stored":22308514,"data_compressed":1141968,"data_compressed_allocated":10817536,"data_compressed_original":22126592,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88976,"kb_used_data":8000,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94282864,"statfs":{"total":96636764160,"available":96545652736,"internally_reserved":0,"allocated":8192000,"data_stored":16090786,"data_compressed":821269,"data_compressed_allocated":7708672,"data_compressed_original":15908864,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706233,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110124,"kb_used_data":11100,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94261716,"statfs":{"total":96636764160,"available":96523997184,"internally_reserved":0,"allocated":11366400,"data_stored":22447759,"data_compressed":1149207,"data_compressed_allocated":10887168,"data_compressed_original":22265856,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10956800,"data_stored":21913600,"data_compressed":1130591,"data_compressed_allocated":10956800,"data_compressed_original":21913600,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":15466496,"data_compressed":798000,"data_compressed_allocated":7733248,"data_compressed_original":15466496,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11436032,"data_stored":22872064,"data_compressed":1180034,"data_compressed_allocated":11436032,"data_compressed_original":22872064,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":21258240,"data_compressed":1096895,"data_compressed_allocated":10629120,"data_compressed_original":21258240,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:49:40.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:40.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:40.237+0000 7f30bb0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:40.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:40.248+0000 7f30bb0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:40.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 43 16 7800 7784 1.41411 1.22656 0.143528 0.0882597 2024-09-16T07:49:41.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 44 16 7983 7967 1.41446 1.42969 0.06256 0.0882801 2024-09-16T07:49:42.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 45 16 8162 8146 1.4141 1.39844 0.0766885 0.0883232 2024-09-16T07:49:42.500 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:42.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:42.653+0000 7feaca0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:42.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:42.662+0000 7feaca0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:43.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 46 16 8326 8310 1.41121 1.28125 0.0921727 0.0884711 2024-09-16T07:49:44.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 47 16 8502 8486 1.41044 1.375 0.17021 0.0885288 2024-09-16T07:49:44.824 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:44.824 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:44.825 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:49:44.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:49:44.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:44.969+0000 7f8237ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:44.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:44.988+0000 7f8237ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.028 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:45.028 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:45.028 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:45.028 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:45.034 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:45.034 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:45.035 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:49:45.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:45.126+0000 7f68384fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:45.138+0000 7f683729b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:45.232+0000 7fe867551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:45.249+0000 7fe867551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 48 16 8664 8648 1.40742 1.26562 0.135627 0.0887437 2024-09-16T07:49:45.406 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:45.406 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:45.406 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:45.406 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:45.406 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:45.406 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:45.407 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:45.407 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:45.407 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:45.407 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:45.407 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:45.407 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:45.410 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:45.411 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:45.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:49:45.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:45.547+0000 7f0375991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:45.557+0000 7f0375991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.679 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:45.679 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:45.679 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:45.679 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:45.679 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:45.679 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:45.679 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:45.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:45.682 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:45.683 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:49:45.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:45.802+0000 7f22d9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:45.812+0000 7f22d9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:45.880 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:45.881 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:46.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 49 16 8818 8802 1.40325 1.20312 0.166451 0.088935 2024-09-16T07:49:47.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:47.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 50 16 8978 8962 1.40018 1.25 0.0831402 0.0891674 2024-09-16T07:49:47.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:47.469+0000 7f78d2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:47.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:47.475+0000 7f78d2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:48.398 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 51 16 9136 9120 1.39693 1.23438 0.0406388 0.0893976 2024-09-16T07:49:49.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 52 16 9306 9290 1.3956 1.32812 0.057282 0.0894622 2024-09-16T07:49:49.756 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:49.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:49.901+0000 7f02d3708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:49.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:49.907+0000 7f02d3708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:50.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 53 16 9469 9453 1.3933 1.27344 0.0674588 0.0896347 2024-09-16T07:49:50.882 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:50.882 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:50.882 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:49:50.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:49:51.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:51.020+0000 7f73d9911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:51.033+0000 7f73d9911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:51.056 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:51.057 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:51.057 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:51.060 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:51.060 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:51.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:49:51.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:51.179+0000 7f79dc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:51.188+0000 7f79dc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:51.229 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:51.230 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:51.230 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:51.233 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:51.233 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:51.234 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:49:51.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:51.369+0000 7f537a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:51.381+0000 7f537a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.401 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 54 16 9623 9607 1.38977 1.20312 0.0818151 0.0898674 2024-09-16T07:49:51.418 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:51.418 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:51.419 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:51.421 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:51.422 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:51.422 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:49:51.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:51.540+0000 7fc29cc7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:51.554+0000 7fc29cc7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:51.683 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:51.683 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:51.683 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:51.683 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:51.683 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:51.683 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:51.684 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:51.684 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:51.684 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:51.684 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:51.684 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:51.684 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:51.687 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:51.687 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:52.077 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:52.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:52.212+0000 7f63c18d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:52.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:52.219+0000 7f63c18d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:52.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 55 16 9777 9761 1.38638 1.20312 0.112066 0.090016 2024-09-16T07:49:53.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 56 15 9951 9936 1.38603 1.36719 0.0439109 0.0900853 2024-09-16T07:49:54.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 57 16 10109 10093 1.38323 1.22656 0.148738 0.0902226 2024-09-16T07:49:54.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:54.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:54.581+0000 7f4300551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:54.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:54.588+0000 7f4300551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:55.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 58 16 10273 10257 1.38147 1.28125 0.129866 0.0903705 2024-09-16T07:49:56.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 59 16 10438 10422 1.37991 1.28906 0.140383 0.0905453 2024-09-16T07:49:56.688 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:49:56.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:49:56.689 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:49:56.689 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:49:56.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:49:56.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:56.814+0000 7f4e74cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:56.830+0000 7f4e74cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:56.848 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:56.849 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:56.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:56.851 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:56.852 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:49:56.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:56.913+0000 7f3583991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:56.920+0000 7f3583991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:57.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:57.025+0000 7f7f5a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:57.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:57.038+0000 7f7f5a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:57.056 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:57.057 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:57.059 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:57.060 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:57.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:49:57.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:57.239+0000 7efdfdcc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:57.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:57.251+0000 7efdfdcc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:57.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:49:57.401007+0000 min lat: 0.0188934 max lat: 0.29091 avg lat: 0.0907974 2024-09-16T07:49:57.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:49:57.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 60 16 10572 10556 1.37435 1.04688 0.169313 0.0907974 2024-09-16T07:49:57.432 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:57.432 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:57.433 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:57.435 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:57.436 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:57.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:49:57.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:57.564+0000 7f539b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:57.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:57.576+0000 7f539b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:57.719 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:49:57.719 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:49:57.719 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:49:57.719 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:49:57.719 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:49:57.719 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:49:57.719 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:49:57.720 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:49:57.720 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:49:57.720 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:49:57.720 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:49:57.720 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:49:57.722 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:49:57.722 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:49:58.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 61 16 10719 10703 1.37065 1.14844 0.168185 0.0910451 2024-09-16T07:49:59.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:49:59.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:59.273+0000 7fd852f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:59.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:49:59.281+0000 7fd852f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:49:59.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 62 16 10873 10857 1.36794 1.20312 0.127984 0.0912567 2024-09-16T07:50:00.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 63 16 11040 11024 1.36694 1.30469 0.113665 0.0913621 2024-09-16T07:50:01.399 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 64 16 11195 11179 1.3645 1.21094 0.104792 0.0914799 2024-09-16T07:50:01.538 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:01.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:01.705+0000 7f5c0cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:01.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:01.714+0000 7f5c0cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:02.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 65 16 11341 11325 1.36105 1.14062 0.134902 0.0917246 2024-09-16T07:50:02.724 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:02.724 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:02.724 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:50:02.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:02.879+0000 7ff088d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:02.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:02.889+0000 7ff088d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:03.159 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:50:03.159 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:50:03.184 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-16T07:50:01.816970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70681139,"num_objects":1074,"num_object_clones":0,"num_object_copies":3222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8637,"num_write_kb":69556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8611,"ondisk_log_size":8611,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":529240,"kb_used_data":104024,"kb_used_omap":0,"kb_used_meta":425152,"kb_avail":376958120,"statfs":{"total":386547056640,"available":386005114880,"internally_reserved":0,"allocated":106520576,"data_stored":211199205,"data_compressed":10863975,"data_compressed_allocated":104480768,"data_compressed_original":210436096,"omap_allocated":0,"internal_metadata":435355648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002401"},"pg_stats":[{"pgid":"8.7","version":"57'560","reported_seq":584,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.489011+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:49:44.489011+0000","last_peered":"2024-09-16T07:49:44.489011+0000","last_clean":"2024-09-16T07:49:44.489011+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:49:44.489011+0000","last_undegraded":"2024-09-16T07:49:44.489011+0000","last_fullsized":"2024-09-16T07:49:44.489011+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"57'392","reported_seq":416,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.698352+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:49:44.698352+0000","last_peered":"2024-09-16T07:49:44.698352+0000","last_clean":"2024-09-16T07:49:44.698352+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:49:44.698352+0000","last_undegraded":"2024-09-16T07:49:44.698352+0000","last_fullsized":"2024-09-16T07:49:44.698352+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"57'536","reported_seq":560,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.426436+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:49:44.426436+0000","last_peered":"2024-09-16T07:49:44.426436+0000","last_clean":"2024-09-16T07:49:44.426436+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:49:44.426436+0000","last_undegraded":"2024-09-16T07:49:44.426436+0000","last_fullsized":"2024-09-16T07:49:44.426436+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"57'568","reported_seq":592,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.184583+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:49:44.184583+0000","last_peered":"2024-09-16T07:49:44.184583+0000","last_clean":"2024-09-16T07:49:44.184583+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:49:44.184583+0000","last_undegraded":"2024-09-16T07:49:44.184583+0000","last_fullsized":"2024-09-16T07:49:44.184583+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"57'536","reported_seq":560,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.905960+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:49:43.905960+0000","last_peered":"2024-09-16T07:49:43.905960+0000","last_clean":"2024-09-16T07:49:43.905960+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:49:43.905960+0000","last_undegraded":"2024-09-16T07:49:43.905960+0000","last_fullsized":"2024-09-16T07:49:43.905960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"57'495","reported_seq":519,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.769875+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:49:44.769875+0000","last_peered":"2024-09-16T07:49:44.769875+0000","last_clean":"2024-09-16T07:49:44.769875+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:49:44.769875+0000","last_undegraded":"2024-09-16T07:49:44.769875+0000","last_fullsized":"2024-09-16T07:49:44.769875+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4055040,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":3960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"57'432","reported_seq":456,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.608954+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:49:43.608954+0000","last_peered":"2024-09-16T07:49:43.608954+0000","last_clean":"2024-09-16T07:49:43.608954+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:49:43.608954+0000","last_undegraded":"2024-09-16T07:49:43.608954+0000","last_fullsized":"2024-09-16T07:49:43.608954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"57'464","reported_seq":488,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.850315+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:49:43.850315+0000","last_peered":"2024-09-16T07:49:43.850315+0000","last_clean":"2024-09-16T07:49:43.850315+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:49:43.850315+0000","last_undegraded":"2024-09-16T07:49:43.850315+0000","last_fullsized":"2024-09-16T07:49:43.850315+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"57'544","reported_seq":568,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.223268+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:49:44.223268+0000","last_peered":"2024-09-16T07:49:44.223268+0000","last_clean":"2024-09-16T07:49:44.223268+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:49:44.223268+0000","last_undegraded":"2024-09-16T07:49:44.223268+0000","last_fullsized":"2024-09-16T07:49:44.223268+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":214,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.909175+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:49:26.909175+0000","last_peered":"2024-09-16T07:49:26.909175+0000","last_clean":"2024-09-16T07:49:26.909175+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:49:26.909175+0000","last_undegraded":"2024-09-16T07:49:26.909175+0000","last_fullsized":"2024-09-16T07:49:26.909175+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":146,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.942979+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:49:26.942979+0000","last_peered":"2024-09-16T07:49:26.942979+0000","last_clean":"2024-09-16T07:49:26.942979+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:49:26.942979+0000","last_undegraded":"2024-09-16T07:49:26.942979+0000","last_fullsized":"2024-09-16T07:49:26.942979+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"57'648","reported_seq":672,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.716952+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:49:43.716952+0000","last_peered":"2024-09-16T07:49:43.716952+0000","last_clean":"2024-09-16T07:49:43.716952+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:49:43.716952+0000","last_undegraded":"2024-09-16T07:49:43.716952+0000","last_fullsized":"2024-09-16T07:49:43.716952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.937918+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:49:26.937918+0000","last_peered":"2024-09-16T07:49:26.937918+0000","last_clean":"2024-09-16T07:49:26.937918+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:49:26.937918+0000","last_undegraded":"2024-09-16T07:49:26.937918+0000","last_fullsized":"2024-09-16T07:49:26.937918+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"57'512","reported_seq":536,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.667266+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:49:44.667266+0000","last_peered":"2024-09-16T07:49:44.667266+0000","last_clean":"2024-09-16T07:49:44.667266+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:49:44.667266+0000","last_undegraded":"2024-09-16T07:49:44.667266+0000","last_fullsized":"2024-09-16T07:49:44.667266+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.936713+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:49:26.936713+0000","last_peered":"2024-09-16T07:49:26.936713+0000","last_clean":"2024-09-16T07:49:26.936713+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:49:26.936713+0000","last_undegraded":"2024-09-16T07:49:26.936713+0000","last_fullsized":"2024-09-16T07:49:26.936713+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"57'512","reported_seq":536,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.429285+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:49:44.429285+0000","last_peered":"2024-09-16T07:49:44.429285+0000","last_clean":"2024-09-16T07:49:44.429285+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:49:44.429285+0000","last_undegraded":"2024-09-16T07:49:44.429285+0000","last_fullsized":"2024-09-16T07:49:44.429285+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":147,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.945200+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:49:26.945200+0000","last_peered":"2024-09-16T07:49:26.945200+0000","last_clean":"2024-09-16T07:49:26.945200+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:49:26.945200+0000","last_undegraded":"2024-09-16T07:49:26.945200+0000","last_fullsized":"2024-09-16T07:49:26.945200+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"57'613","reported_seq":637,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.760895+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:49:44.760895+0000","last_peered":"2024-09-16T07:49:44.760895+0000","last_clean":"2024-09-16T07:49:44.760895+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:49:44.760895+0000","last_undegraded":"2024-09-16T07:49:44.760895+0000","last_fullsized":"2024-09-16T07:49:44.760895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5021696,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.913052+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:49:26.913052+0000","last_peered":"2024-09-16T07:49:26.913052+0000","last_clean":"2024-09-16T07:49:26.913052+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:49:26.913052+0000","last_undegraded":"2024-09-16T07:49:26.913052+0000","last_fullsized":"2024-09-16T07:49:26.913052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"57'664","reported_seq":688,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.059296+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:49:44.059296+0000","last_peered":"2024-09-16T07:49:44.059296+0000","last_clean":"2024-09-16T07:49:44.059296+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:49:44.059296+0000","last_undegraded":"2024-09-16T07:49:44.059296+0000","last_fullsized":"2024-09-16T07:49:44.059296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.911766+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:49:26.911766+0000","last_peered":"2024-09-16T07:49:26.911766+0000","last_clean":"2024-09-16T07:49:26.911766+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:49:26.911766+0000","last_undegraded":"2024-09-16T07:49:26.911766+0000","last_fullsized":"2024-09-16T07:49:26.911766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"57'544","reported_seq":568,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.577015+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:49:44.577015+0000","last_peered":"2024-09-16T07:49:44.577015+0000","last_clean":"2024-09-16T07:49:44.577015+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:49:44.577015+0000","last_undegraded":"2024-09-16T07:49:44.577015+0000","last_fullsized":"2024-09-16T07:49:44.577015+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.907859+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:49:26.907859+0000","last_peered":"2024-09-16T07:49:26.907859+0000","last_clean":"2024-09-16T07:49:26.907859+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:49:26.907859+0000","last_undegraded":"2024-09-16T07:49:26.907859+0000","last_fullsized":"2024-09-16T07:49:26.907859+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"57'536","reported_seq":560,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.050872+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:49:43.050872+0000","last_peered":"2024-09-16T07:49:43.050872+0000","last_clean":"2024-09-16T07:49:43.050872+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:49:43.050872+0000","last_undegraded":"2024-09-16T07:49:43.050872+0000","last_fullsized":"2024-09-16T07:49:43.050872+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.941284+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:49:26.941284+0000","last_peered":"2024-09-16T07:49:26.941284+0000","last_clean":"2024-09-16T07:49:26.941284+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:49:26.941284+0000","last_undegraded":"2024-09-16T07:49:26.941284+0000","last_fullsized":"2024-09-16T07:49:26.941284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":70090752,"num_objects":1070,"num_object_clones":0,"num_object_copies":3210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8556,"num_write_kb":68448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105086976,"data_stored":210173952,"data_compressed":10849158,"data_compressed_allocated":105086976,"data_compressed_original":210173952,"omap_allocated":0,"internal_metadata":0},"log_size":8556,"ondisk_log_size":8556,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129464,"kb_used_data":26280,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94242376,"statfs":{"total":96636764160,"available":96504193024,"internally_reserved":0,"allocated":26910720,"data_stored":53008294,"data_compressed":2727137,"data_compressed_allocated":26415104,"data_compressed_original":52830208,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140476,"kb_used_data":28972,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94231364,"statfs":{"total":96636764160,"available":96492916736,"internally_reserved":0,"allocated":29667328,"data_stored":58988998,"data_compressed":3035316,"data_compressed_allocated":29151232,"data_compressed_original":58793984,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132056,"kb_used_data":20552,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94239784,"statfs":{"total":96636764160,"available":96501538816,"internally_reserved":0,"allocated":21045248,"data_stored":41744838,"data_compressed":2145259,"data_compressed_allocated":20529152,"data_compressed_original":41549824,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127244,"kb_used_data":28220,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94244596,"statfs":{"total":96636764160,"available":96506466304,"internally_reserved":0,"allocated":28897280,"data_stored":57457075,"data_compressed":2956263,"data_compressed_allocated":28385280,"data_compressed_original":57262080,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28397568,"data_stored":56795136,"data_compressed":2931725,"data_compressed_allocated":28397568,"data_compressed_original":56795136,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20512768,"data_stored":41025536,"data_compressed":2117760,"data_compressed_allocated":20512768,"data_compressed_original":41025536,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29671424,"data_stored":59342848,"data_compressed":3063230,"data_compressed_allocated":29671424,"data_compressed_original":59342848,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26505216,"data_stored":53010432,"data_compressed":2736443,"data_compressed_allocated":26505216,"data_compressed_original":53010432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:50:03.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 66 16 11505 11489 1.35984 1.28125 0.0918639 0.0918544 2024-09-16T07:50:03.878 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:04.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:04.036+0000 7fb9cb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:04.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:04.043+0000 7fb9cb391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:04.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 67 16 11665 11649 1.3582 1.25 0.0721748 0.0919786 2024-09-16T07:50:05.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 68 16 11820 11804 1.35603 1.21094 0.0435264 0.0921271 2024-09-16T07:50:06.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:06.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:06.336+0000 7fbc1ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:06.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:06.343+0000 7fbc1ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:06.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 69 16 11940 11924 1.34997 0.9375 0.173646 0.0924761 2024-09-16T07:50:07.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 70 16 12084 12068 1.34675 1.125 0.16976 0.0926817 2024-09-16T07:50:08.186 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:08.186 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:08.186 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:50:08.187 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:50:08.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:08.354+0000 7fbcbf2b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:08.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:08.375+0000 7fbcbf2b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:08.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 71 16 12254 12238 1.34649 1.32812 0.0540932 0.0927618 2024-09-16T07:50:08.422 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:08.422 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:08.422 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:08.422 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:08.422 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:08.422 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:08.423 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:08.429 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:08.430 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:08.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:50:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:08.599+0000 7fec4f4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:08.610+0000 7fec4f4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:08.670 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:08.739 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:08.739 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:08.739 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:08.739 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:08.739 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:08.740 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:08.740 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:08.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:08.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:08.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:08.740 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:08.740 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:08.742 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:08.742 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:08.742 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:50:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:08.798+0000 7f8c26b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:08.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:08.805+0000 7f8c26b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:08.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:08.896+0000 7fab8cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:08.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:08.907+0000 7fab8cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:09.074 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:09.077 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:09.078 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:09.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:50:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:09.224+0000 7f043c8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:09.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:09.236+0000 7f043c8c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:09.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 72 16 12387 12371 1.34222 1.03906 0.0499522 0.0930497 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:09.448 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:09.449 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:09.449 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:09.449 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:09.452 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:09.453 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:10.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 73 16 12532 12516 1.33935 1.13281 0.100843 0.0932183 2024-09-16T07:50:11.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:11.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:11.311+0000 7fac23b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:11.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:11.317+0000 7fac23b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:11.400 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 74 16 12692 12676 1.33814 1.25 0.10974 0.0933349 2024-09-16T07:50:12.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 75 16 12837 12821 1.33538 1.13281 0.0929871 0.093536 2024-09-16T07:50:13.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 76 16 12986 12970 1.33312 1.16406 0.105999 0.0936807 2024-09-16T07:50:13.514 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:13.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:13.629+0000 7efefdd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:13.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:13.635+0000 7efefdd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:14.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 77 16 13126 13110 1.33001 1.09375 0.164741 0.0938952 2024-09-16T07:50:14.454 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:14.454 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:14.455 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:50:14.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:14.616+0000 7ff8c7057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:14.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:14.628+0000 7ff8c7057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:14.862 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:50:14.925 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:50:14.927 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-09-16T07:50:13.819022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":70681139,"num_objects":1074,"num_object_clones":0,"num_object_copies":3222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8637,"num_write_kb":69556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8611,"ondisk_log_size":8611,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":529240,"kb_used_data":104024,"kb_used_omap":0,"kb_used_meta":425152,"kb_avail":376958120,"statfs":{"total":386547056640,"available":386005114880,"internally_reserved":0,"allocated":106520576,"data_stored":211199205,"data_compressed":10863975,"data_compressed_allocated":104480768,"data_compressed_original":210436096,"omap_allocated":0,"internal_metadata":435355648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002051"},"pg_stats":[{"pgid":"8.7","version":"57'560","reported_seq":584,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.489011+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:49:44.489011+0000","last_peered":"2024-09-16T07:49:44.489011+0000","last_clean":"2024-09-16T07:49:44.489011+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:49:44.489011+0000","last_undegraded":"2024-09-16T07:49:44.489011+0000","last_fullsized":"2024-09-16T07:49:44.489011+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4587520,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":4480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"57'392","reported_seq":416,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.698352+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:49:44.698352+0000","last_peered":"2024-09-16T07:49:44.698352+0000","last_clean":"2024-09-16T07:49:44.698352+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:49:44.698352+0000","last_undegraded":"2024-09-16T07:49:44.698352+0000","last_fullsized":"2024-09-16T07:49:44.698352+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"57'536","reported_seq":560,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.426436+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:49:44.426436+0000","last_peered":"2024-09-16T07:49:44.426436+0000","last_clean":"2024-09-16T07:49:44.426436+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:49:44.426436+0000","last_undegraded":"2024-09-16T07:49:44.426436+0000","last_fullsized":"2024-09-16T07:49:44.426436+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"57'568","reported_seq":592,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.184583+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:49:44.184583+0000","last_peered":"2024-09-16T07:49:44.184583+0000","last_clean":"2024-09-16T07:49:44.184583+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:49:44.184583+0000","last_undegraded":"2024-09-16T07:49:44.184583+0000","last_fullsized":"2024-09-16T07:49:44.184583+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653056,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":568,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"57'536","reported_seq":560,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.905960+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:49:43.905960+0000","last_peered":"2024-09-16T07:49:43.905960+0000","last_clean":"2024-09-16T07:49:43.905960+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:49:43.905960+0000","last_undegraded":"2024-09-16T07:49:43.905960+0000","last_fullsized":"2024-09-16T07:49:43.905960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"57'495","reported_seq":519,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.769875+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:49:44.769875+0000","last_peered":"2024-09-16T07:49:44.769875+0000","last_clean":"2024-09-16T07:49:44.769875+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:49:44.769875+0000","last_undegraded":"2024-09-16T07:49:44.769875+0000","last_fullsized":"2024-09-16T07:49:44.769875+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4055040,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":495,"num_write_kb":3960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"57'432","reported_seq":456,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.608954+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:49:43.608954+0000","last_peered":"2024-09-16T07:49:43.608954+0000","last_clean":"2024-09-16T07:49:43.608954+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:49:43.608954+0000","last_undegraded":"2024-09-16T07:49:43.608954+0000","last_fullsized":"2024-09-16T07:49:43.608954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"57'464","reported_seq":488,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.850315+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:49:43.850315+0000","last_peered":"2024-09-16T07:49:43.850315+0000","last_clean":"2024-09-16T07:49:43.850315+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:49:43.850315+0000","last_undegraded":"2024-09-16T07:49:43.850315+0000","last_fullsized":"2024-09-16T07:49:43.850315+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801088,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":3712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"57'544","reported_seq":568,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.223268+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:49:44.223268+0000","last_peered":"2024-09-16T07:49:44.223268+0000","last_clean":"2024-09-16T07:49:44.223268+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:49:44.223268+0000","last_undegraded":"2024-09-16T07:49:44.223268+0000","last_fullsized":"2024-09-16T07:49:44.223268+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":214,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.909175+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:49:26.909175+0000","last_peered":"2024-09-16T07:49:26.909175+0000","last_clean":"2024-09-16T07:49:26.909175+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:49:26.909175+0000","last_undegraded":"2024-09-16T07:49:26.909175+0000","last_fullsized":"2024-09-16T07:49:26.909175+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":146,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.942979+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:49:26.942979+0000","last_peered":"2024-09-16T07:49:26.942979+0000","last_clean":"2024-09-16T07:49:26.942979+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:49:26.942979+0000","last_undegraded":"2024-09-16T07:49:26.942979+0000","last_fullsized":"2024-09-16T07:49:26.942979+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"57'648","reported_seq":672,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.716952+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:49:43.716952+0000","last_peered":"2024-09-16T07:49:43.716952+0000","last_clean":"2024-09-16T07:49:43.716952+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:49:43.716952+0000","last_undegraded":"2024-09-16T07:49:43.716952+0000","last_fullsized":"2024-09-16T07:49:43.716952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.937918+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:49:26.937918+0000","last_peered":"2024-09-16T07:49:26.937918+0000","last_clean":"2024-09-16T07:49:26.937918+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:49:26.937918+0000","last_undegraded":"2024-09-16T07:49:26.937918+0000","last_fullsized":"2024-09-16T07:49:26.937918+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"57'512","reported_seq":536,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.667266+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:49:44.667266+0000","last_peered":"2024-09-16T07:49:44.667266+0000","last_clean":"2024-09-16T07:49:44.667266+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:49:44.667266+0000","last_undegraded":"2024-09-16T07:49:44.667266+0000","last_fullsized":"2024-09-16T07:49:44.667266+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.936713+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:49:26.936713+0000","last_peered":"2024-09-16T07:49:26.936713+0000","last_clean":"2024-09-16T07:49:26.936713+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:49:26.936713+0000","last_undegraded":"2024-09-16T07:49:26.936713+0000","last_fullsized":"2024-09-16T07:49:26.936713+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"57'512","reported_seq":536,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.429285+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:49:44.429285+0000","last_peered":"2024-09-16T07:49:44.429285+0000","last_clean":"2024-09-16T07:49:44.429285+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:49:44.429285+0000","last_undegraded":"2024-09-16T07:49:44.429285+0000","last_fullsized":"2024-09-16T07:49:44.429285+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":147,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.945200+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:49:26.945200+0000","last_peered":"2024-09-16T07:49:26.945200+0000","last_clean":"2024-09-16T07:49:26.945200+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:49:26.945200+0000","last_undegraded":"2024-09-16T07:49:26.945200+0000","last_fullsized":"2024-09-16T07:49:26.945200+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"57'613","reported_seq":637,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.760895+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:49:44.760895+0000","last_peered":"2024-09-16T07:49:44.760895+0000","last_clean":"2024-09-16T07:49:44.760895+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:49:44.760895+0000","last_undegraded":"2024-09-16T07:49:44.760895+0000","last_fullsized":"2024-09-16T07:49:44.760895+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5021696,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":613,"num_write_kb":4904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.913052+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:49:26.913052+0000","last_peered":"2024-09-16T07:49:26.913052+0000","last_clean":"2024-09-16T07:49:26.913052+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:49:26.913052+0000","last_undegraded":"2024-09-16T07:49:26.913052+0000","last_fullsized":"2024-09-16T07:49:26.913052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"57'664","reported_seq":688,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.059296+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:49:44.059296+0000","last_peered":"2024-09-16T07:49:44.059296+0000","last_clean":"2024-09-16T07:49:44.059296+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:49:44.059296+0000","last_undegraded":"2024-09-16T07:49:44.059296+0000","last_fullsized":"2024-09-16T07:49:44.059296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.911766+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:49:26.911766+0000","last_peered":"2024-09-16T07:49:26.911766+0000","last_clean":"2024-09-16T07:49:26.911766+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:49:26.911766+0000","last_undegraded":"2024-09-16T07:49:26.911766+0000","last_fullsized":"2024-09-16T07:49:26.911766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"57'544","reported_seq":568,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:44.577015+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:49:44.577015+0000","last_peered":"2024-09-16T07:49:44.577015+0000","last_clean":"2024-09-16T07:49:44.577015+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:49:44.577015+0000","last_undegraded":"2024-09-16T07:49:44.577015+0000","last_fullsized":"2024-09-16T07:49:44.577015+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456448,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":544,"num_write_kb":4352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.907859+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:49:26.907859+0000","last_peered":"2024-09-16T07:49:26.907859+0000","last_clean":"2024-09-16T07:49:26.907859+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:49:26.907859+0000","last_undegraded":"2024-09-16T07:49:26.907859+0000","last_fullsized":"2024-09-16T07:49:26.907859+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"57'536","reported_seq":560,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:43.050872+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:49:43.050872+0000","last_peered":"2024-09-16T07:49:43.050872+0000","last_clean":"2024-09-16T07:49:43.050872+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:49:43.050872+0000","last_undegraded":"2024-09-16T07:49:43.050872+0000","last_fullsized":"2024-09-16T07:49:43.050872+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4390912,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":4288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.941284+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:49:26.941284+0000","last_peered":"2024-09-16T07:49:26.941284+0000","last_clean":"2024-09-16T07:49:26.941284+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:49:26.941284+0000","last_undegraded":"2024-09-16T07:49:26.941284+0000","last_fullsized":"2024-09-16T07:49:26.941284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":70090752,"num_objects":1070,"num_object_clones":0,"num_object_copies":3210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8556,"num_write_kb":68448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105086976,"data_stored":210173952,"data_compressed":10849158,"data_compressed_allocated":105086976,"data_compressed_original":210173952,"omap_allocated":0,"internal_metadata":0},"log_size":8556,"ondisk_log_size":8556,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129464,"kb_used_data":26280,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94242376,"statfs":{"total":96636764160,"available":96504193024,"internally_reserved":0,"allocated":26910720,"data_stored":53008294,"data_compressed":2727137,"data_compressed_allocated":26415104,"data_compressed_original":52830208,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140476,"kb_used_data":28972,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94231364,"statfs":{"total":96636764160,"available":96492916736,"internally_reserved":0,"allocated":29667328,"data_stored":58988998,"data_compressed":3035316,"data_compressed_allocated":29151232,"data_compressed_original":58793984,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132056,"kb_used_data":20552,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94239784,"statfs":{"total":96636764160,"available":96501538816,"internally_reserved":0,"allocated":21045248,"data_stored":41744838,"data_compressed":2145259,"data_compressed_allocated":20529152,"data_compressed_original":41549824,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127244,"kb_used_data":28220,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94244596,"statfs":{"total":96636764160,"available":96506466304,"internally_reserved":0,"allocated":28897280,"data_stored":57457075,"data_compressed":2956263,"data_compressed_allocated":28385280,"data_compressed_original":57262080,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28397568,"data_stored":56795136,"data_compressed":2931725,"data_compressed_allocated":28397568,"data_compressed_original":56795136,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20512768,"data_stored":41025536,"data_compressed":2117760,"data_compressed_allocated":20512768,"data_compressed_original":41025536,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29671424,"data_stored":59342848,"data_compressed":3063230,"data_compressed_allocated":29671424,"data_compressed_original":59342848,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26505216,"data_stored":53010432,"data_compressed":2736443,"data_compressed_allocated":26505216,"data_compressed_original":53010432,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:50:15.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 78 16 13280 13264 1.32838 1.20312 0.0337355 0.0940094 2024-09-16T07:50:15.756 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:15.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:15.915+0000 7f75e3111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:15.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:15.922+0000 7f75e3111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:16.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 79 16 13415 13399 1.32492 1.05469 0.194938 0.0942395 2024-09-16T07:50:17.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:50:17.404053+0000 min lat: 0.0188934 max lat: 0.29091 avg lat: 0.0943066 2024-09-16T07:50:17.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:50:17.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 80 16 13578 13562 1.32427 1.27344 0.0983601 0.0943066 2024-09-16T07:50:18.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:18.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:18.396+0000 7f8256911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:18.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 81 16 13746 13730 1.32413 1.3125 0.0712765 0.0942977 2024-09-16T07:50:18.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:18.404+0000 7f8256911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:19.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 82 16 13903 13887 1.32294 1.22656 0.185984 0.0943616 2024-09-16T07:50:19.929 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:19.929 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:19.929 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:50:19.929 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:50:20.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.080+0000 7fa6b4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.093+0000 7fa6b4991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.117 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:20.117 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:20.117 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:20.118 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:20.121 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:20.121 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:20.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:50:20.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.238+0000 7f322a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.248+0000 7f322a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.264 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:20.264 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:20.264 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:20.264 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:20.265 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:20.267 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:20.267 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:20.267 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:50:20.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.389+0000 7fd3b3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.399+0000 7fd3b3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 83 16 14065 14049 1.32224 1.26562 0.0887039 0.094458 2024-09-16T07:50:20.414 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:20.414 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:20.414 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:20.415 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:20.418 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:20.419 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:20.419 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:50:20.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.558+0000 7f58a6951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.574+0000 7f58a6951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.681 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:20.707 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:20.710 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:20.710 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:20.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.836+0000 7f512c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:20.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:20.842+0000 7f512c951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:21.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 84 16 14214 14198 1.32036 1.16406 0.0873984 0.0945775 2024-09-16T07:50:22.402 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 85 16 14372 14356 1.31935 1.23438 0.0417917 0.0946963 2024-09-16T07:50:23.078 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:23.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:23.238+0000 7f2f32351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:23.245+0000 7f2f32351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:23.403 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 86 16 14514 14498 1.3169 1.10938 0.0739314 0.0948343 2024-09-16T07:50:24.403 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 87 16 14644 14628 1.31344 1.01562 0.0896257 0.0950417 2024-09-16T07:50:25.403 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 88 16 14783 14767 1.31085 1.08594 0.0778663 0.0952662 2024-09-16T07:50:25.454 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:25.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:25.592+0000 7fee1e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:25.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:25.598+0000 7fee1e751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:25.711 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:25.712 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:25.712 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:50:25.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:25.856+0000 7f9f23391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:25.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:25.870+0000 7f9f23391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:26.168 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:50:26.168 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:50:26.185 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2024-09-16T07:50:25.821354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":108528179,"num_objects":1651,"num_object_clones":0,"num_object_copies":4953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13257,"num_write_kb":106516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13231,"ondisk_log_size":13231,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":597360,"kb_used_data":159664,"kb_used_omap":0,"kb_used_meta":437632,"kb_avail":376890000,"statfs":{"total":386547056640,"available":385935360000,"internally_reserved":0,"allocated":163495936,"data_stored":325149925,"data_compressed":16747902,"data_compressed_allocated":161456128,"data_compressed_original":324386816,"omap_allocated":0,"internal_metadata":448135168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":37847040,"num_objects":577,"num_object_clones":0,"num_object_copies":1731,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4620,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002332"},"pg_stats":[{"pgid":"8.7","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.071447+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:50:14.071447+0000","last_peered":"2024-09-16T07:50:14.071447+0000","last_clean":"2024-09-16T07:50:14.071447+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:50:14.071447+0000","last_undegraded":"2024-09-16T07:50:14.071447+0000","last_fullsized":"2024-09-16T07:50:14.071447+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"57'664","reported_seq":688,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.264403+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:50:13.264403+0000","last_peered":"2024-09-16T07:50:13.264403+0000","last_clean":"2024-09-16T07:50:13.264403+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:50:13.264403+0000","last_undegraded":"2024-09-16T07:50:13.264403+0000","last_fullsized":"2024-09-16T07:50:13.264403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"57'832","reported_seq":856,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.678157+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:50:14.678157+0000","last_peered":"2024-09-16T07:50:14.678157+0000","last_clean":"2024-09-16T07:50:14.678157+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:50:14.678157+0000","last_undegraded":"2024-09-16T07:50:14.678157+0000","last_fullsized":"2024-09-16T07:50:14.678157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"57'776","reported_seq":800,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.446671+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:50:14.446671+0000","last_peered":"2024-09-16T07:50:14.446671+0000","last_clean":"2024-09-16T07:50:14.446671+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:50:14.446671+0000","last_undegraded":"2024-09-16T07:50:14.446671+0000","last_fullsized":"2024-09-16T07:50:14.446671+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.320230+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:50:12.320230+0000","last_peered":"2024-09-16T07:50:12.320230+0000","last_clean":"2024-09-16T07:50:12.320230+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:50:12.320230+0000","last_undegraded":"2024-09-16T07:50:12.320230+0000","last_fullsized":"2024-09-16T07:50:12.320230+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"57'880","reported_seq":904,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.119471+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:50:14.119471+0000","last_peered":"2024-09-16T07:50:14.119471+0000","last_clean":"2024-09-16T07:50:14.119471+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:50:14.119471+0000","last_undegraded":"2024-09-16T07:50:14.119471+0000","last_fullsized":"2024-09-16T07:50:14.119471+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"57'784","reported_seq":808,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.625074+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:50:14.625074+0000","last_peered":"2024-09-16T07:50:14.625074+0000","last_clean":"2024-09-16T07:50:14.625074+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:50:14.625074+0000","last_undegraded":"2024-09-16T07:50:14.625074+0000","last_fullsized":"2024-09-16T07:50:14.625074+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"57'792","reported_seq":816,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.846529+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:50:12.846529+0000","last_peered":"2024-09-16T07:50:12.846529+0000","last_clean":"2024-09-16T07:50:12.846529+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:50:12.846529+0000","last_undegraded":"2024-09-16T07:50:12.846529+0000","last_fullsized":"2024-09-16T07:50:12.846529+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"57'784","reported_seq":808,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.454689+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:50:13.454689+0000","last_peered":"2024-09-16T07:50:13.454689+0000","last_clean":"2024-09-16T07:50:13.454689+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:50:13.454689+0000","last_undegraded":"2024-09-16T07:50:13.454689+0000","last_fullsized":"2024-09-16T07:50:13.454689+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":214,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.909175+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:49:26.909175+0000","last_peered":"2024-09-16T07:49:26.909175+0000","last_clean":"2024-09-16T07:49:26.909175+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:49:26.909175+0000","last_undegraded":"2024-09-16T07:49:26.909175+0000","last_fullsized":"2024-09-16T07:49:26.909175+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":146,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.942979+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:49:26.942979+0000","last_peered":"2024-09-16T07:49:26.942979+0000","last_clean":"2024-09-16T07:49:26.942979+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:49:26.942979+0000","last_undegraded":"2024-09-16T07:49:26.942979+0000","last_fullsized":"2024-09-16T07:49:26.942979+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"57'928","reported_seq":952,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.996378+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:50:13.996378+0000","last_peered":"2024-09-16T07:50:13.996378+0000","last_clean":"2024-09-16T07:50:13.996378+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:50:13.996378+0000","last_undegraded":"2024-09-16T07:50:13.996378+0000","last_fullsized":"2024-09-16T07:50:13.996378+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.937918+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:49:26.937918+0000","last_peered":"2024-09-16T07:49:26.937918+0000","last_clean":"2024-09-16T07:49:26.937918+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:49:26.937918+0000","last_undegraded":"2024-09-16T07:49:26.937918+0000","last_fullsized":"2024-09-16T07:49:26.937918+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.406270+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:50:14.406270+0000","last_peered":"2024-09-16T07:50:14.406270+0000","last_clean":"2024-09-16T07:50:14.406270+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:50:14.406270+0000","last_undegraded":"2024-09-16T07:50:14.406270+0000","last_fullsized":"2024-09-16T07:50:14.406270+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.936713+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:49:26.936713+0000","last_peered":"2024-09-16T07:49:26.936713+0000","last_clean":"2024-09-16T07:49:26.936713+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:49:26.936713+0000","last_undegraded":"2024-09-16T07:49:26.936713+0000","last_fullsized":"2024-09-16T07:49:26.936713+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"57'848","reported_seq":872,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.297446+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:50:14.297446+0000","last_peered":"2024-09-16T07:50:14.297446+0000","last_clean":"2024-09-16T07:50:14.297446+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:50:14.297446+0000","last_undegraded":"2024-09-16T07:50:14.297446+0000","last_fullsized":"2024-09-16T07:50:14.297446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":147,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.945200+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:49:26.945200+0000","last_peered":"2024-09-16T07:49:26.945200+0000","last_clean":"2024-09-16T07:49:26.945200+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:49:26.945200+0000","last_undegraded":"2024-09-16T07:49:26.945200+0000","last_fullsized":"2024-09-16T07:49:26.945200+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"57'888","reported_seq":912,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.763579+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:50:14.763579+0000","last_peered":"2024-09-16T07:50:14.763579+0000","last_clean":"2024-09-16T07:50:14.763579+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:50:14.763579+0000","last_undegraded":"2024-09-16T07:50:14.763579+0000","last_fullsized":"2024-09-16T07:50:14.763579+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.913052+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:49:26.913052+0000","last_peered":"2024-09-16T07:49:26.913052+0000","last_clean":"2024-09-16T07:49:26.913052+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:49:26.913052+0000","last_undegraded":"2024-09-16T07:49:26.913052+0000","last_fullsized":"2024-09-16T07:49:26.913052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"57'984","reported_seq":1008,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.512272+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:50:12.512272+0000","last_peered":"2024-09-16T07:50:12.512272+0000","last_clean":"2024-09-16T07:50:12.512272+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:50:12.512272+0000","last_undegraded":"2024-09-16T07:50:12.512272+0000","last_fullsized":"2024-09-16T07:50:12.512272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.911766+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:49:26.911766+0000","last_peered":"2024-09-16T07:49:26.911766+0000","last_clean":"2024-09-16T07:49:26.911766+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:49:26.911766+0000","last_undegraded":"2024-09-16T07:49:26.911766+0000","last_fullsized":"2024-09-16T07:49:26.911766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"57'800","reported_seq":824,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.721599+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:50:14.721599+0000","last_peered":"2024-09-16T07:50:14.721599+0000","last_clean":"2024-09-16T07:50:14.721599+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:50:14.721599+0000","last_undegraded":"2024-09-16T07:50:14.721599+0000","last_fullsized":"2024-09-16T07:50:14.721599+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.907859+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:49:26.907859+0000","last_peered":"2024-09-16T07:49:26.907859+0000","last_clean":"2024-09-16T07:49:26.907859+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:49:26.907859+0000","last_undegraded":"2024-09-16T07:49:26.907859+0000","last_fullsized":"2024-09-16T07:49:26.907859+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"57'792","reported_seq":816,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.352001+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:50:14.352001+0000","last_peered":"2024-09-16T07:50:14.352001+0000","last_clean":"2024-09-16T07:50:14.352001+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:50:14.352001+0000","last_undegraded":"2024-09-16T07:50:14.352001+0000","last_fullsized":"2024-09-16T07:50:14.352001+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.941284+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:49:26.941284+0000","last_peered":"2024-09-16T07:49:26.941284+0000","last_clean":"2024-09-16T07:49:26.941284+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:49:26.941284+0000","last_undegraded":"2024-09-16T07:49:26.941284+0000","last_fullsized":"2024-09-16T07:49:26.941284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161882112,"data_stored":323764224,"data_compressed":16714473,"data_compressed_allocated":161882112,"data_compressed_original":323764224,"omap_allocated":0,"internal_metadata":0},"log_size":13176,"ondisk_log_size":13176,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143716,"kb_used_data":40532,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94228124,"statfs":{"total":96636764160,"available":96489598976,"internally_reserved":0,"allocated":41504768,"data_stored":82196390,"data_compressed":4234285,"data_compressed_allocated":41009152,"data_compressed_original":82018304,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706292,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":156656,"kb_used_data":45152,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94215184,"statfs":{"total":96636764160,"available":96476348416,"internally_reserved":0,"allocated":46235648,"data_stored":92125638,"data_compressed":4746351,"data_compressed_allocated":45719552,"data_compressed_original":91930624,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137784,"kb_used_data":30440,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94234056,"statfs":{"total":96636764160,"available":96495673344,"internally_reserved":0,"allocated":31170560,"data_stored":61995462,"data_compressed":3190914,"data_compressed_allocated":30654464,"data_compressed_original":61800448,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":159204,"kb_used_data":43540,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94212636,"statfs":{"total":96636764160,"available":96473739264,"internally_reserved":0,"allocated":44584960,"data_stored":88832435,"data_compressed":4576352,"data_compressed_allocated":44072960,"data_compressed_original":88637440,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44068864,"data_stored":88137728,"data_compressed":4550122,"data_compressed_allocated":44068864,"data_compressed_original":88137728,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30638080,"data_stored":61276160,"data_compressed":3163415,"data_compressed_allocated":30638080,"data_compressed_original":61276160,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46125056,"data_stored":92250112,"data_compressed":4762421,"data_compressed_allocated":46125056,"data_compressed_original":92250112,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41050112,"data_stored":82100224,"data_compressed":4238515,"data_compressed_allocated":41050112,"data_compressed_original":82100224,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:50:26.403 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 89 16 14909 14893 1.30718 0.984375 0.151026 0.0955166 2024-09-16T07:50:27.403 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 90 11 15058 15047 1.30603 1.20312 0.171419 0.0956532 2024-09-16T07:50:27.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:27.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:27.900+0000 7f130969c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:27.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:27.906+0000 7f130969c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:28.403 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total time run: 90.0244 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total writes made: 15058 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Write size: 8192 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object size: 65536 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Bandwidth (MB/sec): 1.30676 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Bandwidth: 0.149617 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max bandwidth (MB/sec): 1.61719 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min bandwidth (MB/sec): 0.9375 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average IOPS: 167 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev IOPS: 19.151 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max IOPS: 207 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min IOPS: 120 2024-09-16T07:50:28.404 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average Latency(s): 0.0956386 2024-09-16T07:50:28.405 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Latency(s): 0.0390066 2024-09-16T07:50:28.405 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max latency(s): 0.29091 2024-09-16T07:50:28.405 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min latency(s): 0.0188934 2024-09-16T07:50:28.427 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:50:30.002 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:30.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:30.153+0000 7fd183f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:30.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:30.161+0000 7fd183f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:31.188 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:31.188 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:31.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:50:31.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:31.333+0000 7ff47b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:31.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:31.343+0000 7ff47b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:31.668 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:50:31.668 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:50:31.687 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-09-16T07:50:29.822054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":108528179,"num_objects":1651,"num_object_clones":0,"num_object_copies":4953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13257,"num_write_kb":106516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13231,"ondisk_log_size":13231,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":597360,"kb_used_data":159664,"kb_used_omap":0,"kb_used_meta":437632,"kb_avail":376890000,"statfs":{"total":386547056640,"available":385935360000,"internally_reserved":0,"allocated":163495936,"data_stored":325149925,"data_compressed":16747902,"data_compressed_allocated":161456128,"data_compressed_original":324386816,"omap_allocated":0,"internal_metadata":448135168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002195"},"pg_stats":[{"pgid":"8.7","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.071447+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:50:14.071447+0000","last_peered":"2024-09-16T07:50:14.071447+0000","last_clean":"2024-09-16T07:50:14.071447+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:50:14.071447+0000","last_undegraded":"2024-09-16T07:50:14.071447+0000","last_fullsized":"2024-09-16T07:50:14.071447+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"57'664","reported_seq":688,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.264403+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:50:13.264403+0000","last_peered":"2024-09-16T07:50:13.264403+0000","last_clean":"2024-09-16T07:50:13.264403+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:50:13.264403+0000","last_undegraded":"2024-09-16T07:50:13.264403+0000","last_fullsized":"2024-09-16T07:50:13.264403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"57'832","reported_seq":856,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.678157+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:50:14.678157+0000","last_peered":"2024-09-16T07:50:14.678157+0000","last_clean":"2024-09-16T07:50:14.678157+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:50:14.678157+0000","last_undegraded":"2024-09-16T07:50:14.678157+0000","last_fullsized":"2024-09-16T07:50:14.678157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"57'776","reported_seq":800,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.446671+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:50:14.446671+0000","last_peered":"2024-09-16T07:50:14.446671+0000","last_clean":"2024-09-16T07:50:14.446671+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:50:14.446671+0000","last_undegraded":"2024-09-16T07:50:14.446671+0000","last_fullsized":"2024-09-16T07:50:14.446671+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.320230+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:50:12.320230+0000","last_peered":"2024-09-16T07:50:12.320230+0000","last_clean":"2024-09-16T07:50:12.320230+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:50:12.320230+0000","last_undegraded":"2024-09-16T07:50:12.320230+0000","last_fullsized":"2024-09-16T07:50:12.320230+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"57'880","reported_seq":904,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.119471+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:50:14.119471+0000","last_peered":"2024-09-16T07:50:14.119471+0000","last_clean":"2024-09-16T07:50:14.119471+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:50:14.119471+0000","last_undegraded":"2024-09-16T07:50:14.119471+0000","last_fullsized":"2024-09-16T07:50:14.119471+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"57'784","reported_seq":808,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.625074+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:50:14.625074+0000","last_peered":"2024-09-16T07:50:14.625074+0000","last_clean":"2024-09-16T07:50:14.625074+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:50:14.625074+0000","last_undegraded":"2024-09-16T07:50:14.625074+0000","last_fullsized":"2024-09-16T07:50:14.625074+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"57'792","reported_seq":816,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.846529+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:50:12.846529+0000","last_peered":"2024-09-16T07:50:12.846529+0000","last_clean":"2024-09-16T07:50:12.846529+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:50:12.846529+0000","last_undegraded":"2024-09-16T07:50:12.846529+0000","last_fullsized":"2024-09-16T07:50:12.846529+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"57'784","reported_seq":808,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.454689+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:50:13.454689+0000","last_peered":"2024-09-16T07:50:13.454689+0000","last_clean":"2024-09-16T07:50:13.454689+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:50:13.454689+0000","last_undegraded":"2024-09-16T07:50:13.454689+0000","last_fullsized":"2024-09-16T07:50:13.454689+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":214,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.909175+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:49:26.909175+0000","last_peered":"2024-09-16T07:49:26.909175+0000","last_clean":"2024-09-16T07:49:26.909175+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:49:26.909175+0000","last_undegraded":"2024-09-16T07:49:26.909175+0000","last_fullsized":"2024-09-16T07:49:26.909175+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":146,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.942979+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:49:26.942979+0000","last_peered":"2024-09-16T07:49:26.942979+0000","last_clean":"2024-09-16T07:49:26.942979+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:49:26.942979+0000","last_undegraded":"2024-09-16T07:49:26.942979+0000","last_fullsized":"2024-09-16T07:49:26.942979+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"57'928","reported_seq":952,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.996378+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:50:13.996378+0000","last_peered":"2024-09-16T07:50:13.996378+0000","last_clean":"2024-09-16T07:50:13.996378+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:50:13.996378+0000","last_undegraded":"2024-09-16T07:50:13.996378+0000","last_fullsized":"2024-09-16T07:50:13.996378+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.937918+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:49:26.937918+0000","last_peered":"2024-09-16T07:49:26.937918+0000","last_clean":"2024-09-16T07:49:26.937918+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:49:26.937918+0000","last_undegraded":"2024-09-16T07:49:26.937918+0000","last_fullsized":"2024-09-16T07:49:26.937918+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.406270+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:50:14.406270+0000","last_peered":"2024-09-16T07:50:14.406270+0000","last_clean":"2024-09-16T07:50:14.406270+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:50:14.406270+0000","last_undegraded":"2024-09-16T07:50:14.406270+0000","last_fullsized":"2024-09-16T07:50:14.406270+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.936713+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:49:26.936713+0000","last_peered":"2024-09-16T07:49:26.936713+0000","last_clean":"2024-09-16T07:49:26.936713+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:49:26.936713+0000","last_undegraded":"2024-09-16T07:49:26.936713+0000","last_fullsized":"2024-09-16T07:49:26.936713+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"57'848","reported_seq":872,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.297446+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:50:14.297446+0000","last_peered":"2024-09-16T07:50:14.297446+0000","last_clean":"2024-09-16T07:50:14.297446+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:50:14.297446+0000","last_undegraded":"2024-09-16T07:50:14.297446+0000","last_fullsized":"2024-09-16T07:50:14.297446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":147,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.945200+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:49:26.945200+0000","last_peered":"2024-09-16T07:49:26.945200+0000","last_clean":"2024-09-16T07:49:26.945200+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:49:26.945200+0000","last_undegraded":"2024-09-16T07:49:26.945200+0000","last_fullsized":"2024-09-16T07:49:26.945200+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"57'888","reported_seq":912,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.763579+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:50:14.763579+0000","last_peered":"2024-09-16T07:50:14.763579+0000","last_clean":"2024-09-16T07:50:14.763579+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:50:14.763579+0000","last_undegraded":"2024-09-16T07:50:14.763579+0000","last_fullsized":"2024-09-16T07:50:14.763579+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.913052+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:49:26.913052+0000","last_peered":"2024-09-16T07:49:26.913052+0000","last_clean":"2024-09-16T07:49:26.913052+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:49:26.913052+0000","last_undegraded":"2024-09-16T07:49:26.913052+0000","last_fullsized":"2024-09-16T07:49:26.913052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"57'984","reported_seq":1008,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.512272+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:50:12.512272+0000","last_peered":"2024-09-16T07:50:12.512272+0000","last_clean":"2024-09-16T07:50:12.512272+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:50:12.512272+0000","last_undegraded":"2024-09-16T07:50:12.512272+0000","last_fullsized":"2024-09-16T07:50:12.512272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.911766+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:49:26.911766+0000","last_peered":"2024-09-16T07:49:26.911766+0000","last_clean":"2024-09-16T07:49:26.911766+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:49:26.911766+0000","last_undegraded":"2024-09-16T07:49:26.911766+0000","last_fullsized":"2024-09-16T07:49:26.911766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"57'800","reported_seq":824,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.721599+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:50:14.721599+0000","last_peered":"2024-09-16T07:50:14.721599+0000","last_clean":"2024-09-16T07:50:14.721599+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:50:14.721599+0000","last_undegraded":"2024-09-16T07:50:14.721599+0000","last_fullsized":"2024-09-16T07:50:14.721599+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.907859+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:49:26.907859+0000","last_peered":"2024-09-16T07:49:26.907859+0000","last_clean":"2024-09-16T07:49:26.907859+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:49:26.907859+0000","last_undegraded":"2024-09-16T07:49:26.907859+0000","last_fullsized":"2024-09-16T07:49:26.907859+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"57'792","reported_seq":816,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.352001+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:50:14.352001+0000","last_peered":"2024-09-16T07:50:14.352001+0000","last_clean":"2024-09-16T07:50:14.352001+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:50:14.352001+0000","last_undegraded":"2024-09-16T07:50:14.352001+0000","last_fullsized":"2024-09-16T07:50:14.352001+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.941284+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:49:26.941284+0000","last_peered":"2024-09-16T07:49:26.941284+0000","last_clean":"2024-09-16T07:49:26.941284+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:49:26.941284+0000","last_undegraded":"2024-09-16T07:49:26.941284+0000","last_fullsized":"2024-09-16T07:49:26.941284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161882112,"data_stored":323764224,"data_compressed":16714473,"data_compressed_allocated":161882112,"data_compressed_original":323764224,"omap_allocated":0,"internal_metadata":0},"log_size":13176,"ondisk_log_size":13176,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143716,"kb_used_data":40532,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94228124,"statfs":{"total":96636764160,"available":96489598976,"internally_reserved":0,"allocated":41504768,"data_stored":82196390,"data_compressed":4234285,"data_compressed_allocated":41009152,"data_compressed_original":82018304,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706292,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":156656,"kb_used_data":45152,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94215184,"statfs":{"total":96636764160,"available":96476348416,"internally_reserved":0,"allocated":46235648,"data_stored":92125638,"data_compressed":4746351,"data_compressed_allocated":45719552,"data_compressed_original":91930624,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137784,"kb_used_data":30440,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94234056,"statfs":{"total":96636764160,"available":96495673344,"internally_reserved":0,"allocated":31170560,"data_stored":61995462,"data_compressed":3190914,"data_compressed_allocated":30654464,"data_compressed_original":61800448,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":159204,"kb_used_data":43540,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94212636,"statfs":{"total":96636764160,"available":96473739264,"internally_reserved":0,"allocated":44584960,"data_stored":88832435,"data_compressed":4576352,"data_compressed_allocated":44072960,"data_compressed_original":88637440,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44068864,"data_stored":88137728,"data_compressed":4550122,"data_compressed_allocated":44068864,"data_compressed_original":88137728,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30638080,"data_stored":61276160,"data_compressed":3163415,"data_compressed_allocated":30638080,"data_compressed_original":61276160,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46125056,"data_stored":92250112,"data_compressed":4762421,"data_compressed_allocated":46125056,"data_compressed_original":92250112,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41050112,"data_stored":82100224,"data_compressed":4238515,"data_compressed_allocated":41050112,"data_compressed_original":82100224,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:50:32.488 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:32.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:32.629+0000 7faf49b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:32.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:32.636+0000 7faf49b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:34.884 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:35.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:35.022+0000 7f4955f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:35.030+0000 7f4955f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:36.689 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:36.689 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:36.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:50:36.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:36.822+0000 7f8ff7711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:36.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:36.834+0000 7f8ff7711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:37.156 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:50:37.156 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:50:37.174 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-09-16T07:50:35.823242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":108528179,"num_objects":1651,"num_object_clones":0,"num_object_copies":4953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13257,"num_write_kb":106516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13231,"ondisk_log_size":13231,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":597360,"kb_used_data":159664,"kb_used_omap":0,"kb_used_meta":437632,"kb_avail":376890000,"statfs":{"total":386547056640,"available":385935360000,"internally_reserved":0,"allocated":163495936,"data_stored":325149925,"data_compressed":16747902,"data_compressed_allocated":161456128,"data_compressed_original":324386816,"omap_allocated":0,"internal_metadata":448135168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002255"},"pg_stats":[{"pgid":"8.7","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.071447+0000","last_change":"2024-09-16T07:48:56.491483+0000","last_active":"2024-09-16T07:50:14.071447+0000","last_peered":"2024-09-16T07:50:14.071447+0000","last_clean":"2024-09-16T07:50:14.071447+0000","last_became_active":"2024-09-16T07:48:56.481032+0000","last_became_peered":"2024-09-16T07:48:56.481032+0000","last_unstale":"2024-09-16T07:50:14.071447+0000","last_undegraded":"2024-09-16T07:50:14.071447+0000","last_fullsized":"2024-09-16T07:50:14.071447+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.6","version":"57'664","reported_seq":688,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.264403+0000","last_change":"2024-09-16T07:48:56.477383+0000","last_active":"2024-09-16T07:50:13.264403+0000","last_peered":"2024-09-16T07:50:13.264403+0000","last_clean":"2024-09-16T07:50:13.264403+0000","last_became_active":"2024-09-16T07:48:56.468059+0000","last_became_peered":"2024-09-16T07:48:56.468059+0000","last_unstale":"2024-09-16T07:50:13.264403+0000","last_undegraded":"2024-09-16T07:50:13.264403+0000","last_fullsized":"2024-09-16T07:50:13.264403+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":664,"num_write_kb":5312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"57'832","reported_seq":856,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.678157+0000","last_change":"2024-09-16T07:48:56.465267+0000","last_active":"2024-09-16T07:50:14.678157+0000","last_peered":"2024-09-16T07:50:14.678157+0000","last_clean":"2024-09-16T07:50:14.678157+0000","last_became_active":"2024-09-16T07:48:56.453323+0000","last_became_peered":"2024-09-16T07:48:56.453323+0000","last_unstale":"2024-09-16T07:50:14.678157+0000","last_undegraded":"2024-09-16T07:50:14.678157+0000","last_fullsized":"2024-09-16T07:50:14.678157+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.4","version":"57'776","reported_seq":800,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.446671+0000","last_change":"2024-09-16T07:48:56.431565+0000","last_active":"2024-09-16T07:50:14.446671+0000","last_peered":"2024-09-16T07:50:14.446671+0000","last_clean":"2024-09-16T07:50:14.446671+0000","last_became_active":"2024-09-16T07:48:56.425527+0000","last_became_peered":"2024-09-16T07:48:56.425527+0000","last_unstale":"2024-09-16T07:50:14.446671+0000","last_undegraded":"2024-09-16T07:50:14.446671+0000","last_fullsized":"2024-09-16T07:50:14.446671+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6356992,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":6208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.320230+0000","last_change":"2024-09-16T07:48:56.548474+0000","last_active":"2024-09-16T07:50:12.320230+0000","last_peered":"2024-09-16T07:50:12.320230+0000","last_clean":"2024-09-16T07:50:12.320230+0000","last_became_active":"2024-09-16T07:48:56.543763+0000","last_became_peered":"2024-09-16T07:48:56.543763+0000","last_unstale":"2024-09-16T07:50:12.320230+0000","last_undegraded":"2024-09-16T07:50:12.320230+0000","last_fullsized":"2024-09-16T07:50:12.320230+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"57'880","reported_seq":904,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.119471+0000","last_change":"2024-09-16T07:48:56.452941+0000","last_active":"2024-09-16T07:50:14.119471+0000","last_peered":"2024-09-16T07:50:14.119471+0000","last_clean":"2024-09-16T07:50:14.119471+0000","last_became_active":"2024-09-16T07:48:56.441900+0000","last_became_peered":"2024-09-16T07:48:56.441900+0000","last_unstale":"2024-09-16T07:50:14.119471+0000","last_undegraded":"2024-09-16T07:50:14.119471+0000","last_fullsized":"2024-09-16T07:50:14.119471+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"57'784","reported_seq":808,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.625074+0000","last_change":"2024-09-16T07:48:56.438734+0000","last_active":"2024-09-16T07:50:14.625074+0000","last_peered":"2024-09-16T07:50:14.625074+0000","last_clean":"2024-09-16T07:50:14.625074+0000","last_became_active":"2024-09-16T07:48:56.420660+0000","last_became_peered":"2024-09-16T07:48:56.420660+0000","last_unstale":"2024-09-16T07:50:14.625074+0000","last_undegraded":"2024-09-16T07:50:14.625074+0000","last_fullsized":"2024-09-16T07:50:14.625074+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"57'792","reported_seq":816,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.846529+0000","last_change":"2024-09-16T07:48:56.473133+0000","last_active":"2024-09-16T07:50:12.846529+0000","last_peered":"2024-09-16T07:50:12.846529+0000","last_clean":"2024-09-16T07:50:12.846529+0000","last_became_active":"2024-09-16T07:48:56.458977+0000","last_became_peered":"2024-09-16T07:48:56.458977+0000","last_unstale":"2024-09-16T07:50:12.846529+0000","last_undegraded":"2024-09-16T07:50:12.846529+0000","last_fullsized":"2024-09-16T07:50:12.846529+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"57'784","reported_seq":808,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.454689+0000","last_change":"2024-09-16T07:48:56.532338+0000","last_active":"2024-09-16T07:50:13.454689+0000","last_peered":"2024-09-16T07:50:13.454689+0000","last_clean":"2024-09-16T07:50:13.454689+0000","last_became_active":"2024-09-16T07:48:56.523671+0000","last_became_peered":"2024-09-16T07:48:56.523671+0000","last_unstale":"2024-09-16T07:50:13.454689+0000","last_undegraded":"2024-09-16T07:50:13.454689+0000","last_fullsized":"2024-09-16T07:50:13.454689+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":214,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.909175+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:49:26.909175+0000","last_peered":"2024-09-16T07:49:26.909175+0000","last_clean":"2024-09-16T07:49:26.909175+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:49:26.909175+0000","last_undegraded":"2024-09-16T07:49:26.909175+0000","last_fullsized":"2024-09-16T07:49:26.909175+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":146,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.942979+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:49:26.942979+0000","last_peered":"2024-09-16T07:49:26.942979+0000","last_clean":"2024-09-16T07:49:26.942979+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:49:26.942979+0000","last_undegraded":"2024-09-16T07:49:26.942979+0000","last_fullsized":"2024-09-16T07:49:26.942979+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"57'928","reported_seq":952,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:13.996378+0000","last_change":"2024-09-16T07:48:56.457833+0000","last_active":"2024-09-16T07:50:13.996378+0000","last_peered":"2024-09-16T07:50:13.996378+0000","last_clean":"2024-09-16T07:50:13.996378+0000","last_became_active":"2024-09-16T07:48:56.449068+0000","last_became_peered":"2024-09-16T07:48:56.449068+0000","last_unstale":"2024-09-16T07:50:13.996378+0000","last_undegraded":"2024-09-16T07:50:13.996378+0000","last_fullsized":"2024-09-16T07:50:13.996378+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.937918+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:49:26.937918+0000","last_peered":"2024-09-16T07:49:26.937918+0000","last_clean":"2024-09-16T07:49:26.937918+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:49:26.937918+0000","last_undegraded":"2024-09-16T07:49:26.937918+0000","last_fullsized":"2024-09-16T07:49:26.937918+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"57'808","reported_seq":832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.406270+0000","last_change":"2024-09-16T07:48:56.468090+0000","last_active":"2024-09-16T07:50:14.406270+0000","last_peered":"2024-09-16T07:50:14.406270+0000","last_clean":"2024-09-16T07:50:14.406270+0000","last_became_active":"2024-09-16T07:48:56.459292+0000","last_became_peered":"2024-09-16T07:48:56.459292+0000","last_unstale":"2024-09-16T07:50:14.406270+0000","last_undegraded":"2024-09-16T07:50:14.406270+0000","last_fullsized":"2024-09-16T07:50:14.406270+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.936713+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:49:26.936713+0000","last_peered":"2024-09-16T07:49:26.936713+0000","last_clean":"2024-09-16T07:49:26.936713+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:49:26.936713+0000","last_undegraded":"2024-09-16T07:49:26.936713+0000","last_fullsized":"2024-09-16T07:49:26.936713+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"57'848","reported_seq":872,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.297446+0000","last_change":"2024-09-16T07:48:56.525831+0000","last_active":"2024-09-16T07:50:14.297446+0000","last_peered":"2024-09-16T07:50:14.297446+0000","last_clean":"2024-09-16T07:50:14.297446+0000","last_became_active":"2024-09-16T07:48:56.516212+0000","last_became_peered":"2024-09-16T07:48:56.516212+0000","last_unstale":"2024-09-16T07:50:14.297446+0000","last_undegraded":"2024-09-16T07:50:14.297446+0000","last_fullsized":"2024-09-16T07:50:14.297446+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":6784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":147,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.945200+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:49:26.945200+0000","last_peered":"2024-09-16T07:49:26.945200+0000","last_clean":"2024-09-16T07:49:26.945200+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:49:26.945200+0000","last_undegraded":"2024-09-16T07:49:26.945200+0000","last_fullsized":"2024-09-16T07:49:26.945200+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"57'888","reported_seq":912,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.763579+0000","last_change":"2024-09-16T07:48:56.523210+0000","last_active":"2024-09-16T07:50:14.763579+0000","last_peered":"2024-09-16T07:50:14.763579+0000","last_clean":"2024-09-16T07:50:14.763579+0000","last_became_active":"2024-09-16T07:48:56.515914+0000","last_became_peered":"2024-09-16T07:48:56.515914+0000","last_unstale":"2024-09-16T07:50:14.763579+0000","last_undegraded":"2024-09-16T07:50:14.763579+0000","last_fullsized":"2024-09-16T07:50:14.763579+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.913052+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:49:26.913052+0000","last_peered":"2024-09-16T07:49:26.913052+0000","last_clean":"2024-09-16T07:49:26.913052+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:49:26.913052+0000","last_undegraded":"2024-09-16T07:49:26.913052+0000","last_fullsized":"2024-09-16T07:49:26.913052+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"57'984","reported_seq":1008,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:12.512272+0000","last_change":"2024-09-16T07:48:56.434687+0000","last_active":"2024-09-16T07:50:12.512272+0000","last_peered":"2024-09-16T07:50:12.512272+0000","last_clean":"2024-09-16T07:50:12.512272+0000","last_became_active":"2024-09-16T07:48:56.424225+0000","last_became_peered":"2024-09-16T07:48:56.424225+0000","last_unstale":"2024-09-16T07:50:12.512272+0000","last_undegraded":"2024-09-16T07:50:12.512272+0000","last_fullsized":"2024-09-16T07:50:12.512272+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":984,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.911766+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:49:26.911766+0000","last_peered":"2024-09-16T07:49:26.911766+0000","last_clean":"2024-09-16T07:49:26.911766+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:49:26.911766+0000","last_undegraded":"2024-09-16T07:49:26.911766+0000","last_fullsized":"2024-09-16T07:49:26.911766+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"57'800","reported_seq":824,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.721599+0000","last_change":"2024-09-16T07:48:56.479170+0000","last_active":"2024-09-16T07:50:14.721599+0000","last_peered":"2024-09-16T07:50:14.721599+0000","last_clean":"2024-09-16T07:50:14.721599+0000","last_became_active":"2024-09-16T07:48:56.466642+0000","last_became_peered":"2024-09-16T07:48:56.466642+0000","last_unstale":"2024-09-16T07:50:14.721599+0000","last_undegraded":"2024-09-16T07:50:14.721599+0000","last_fullsized":"2024-09-16T07:50:14.721599+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.907859+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:49:26.907859+0000","last_peered":"2024-09-16T07:49:26.907859+0000","last_clean":"2024-09-16T07:49:26.907859+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:49:26.907859+0000","last_undegraded":"2024-09-16T07:49:26.907859+0000","last_fullsized":"2024-09-16T07:49:26.907859+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"57'792","reported_seq":816,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:50:14.352001+0000","last_change":"2024-09-16T07:48:56.504226+0000","last_active":"2024-09-16T07:50:14.352001+0000","last_peered":"2024-09-16T07:50:14.352001+0000","last_clean":"2024-09-16T07:50:14.352001+0000","last_became_active":"2024-09-16T07:48:56.487479+0000","last_became_peered":"2024-09-16T07:48:56.487479+0000","last_unstale":"2024-09-16T07:50:14.352001+0000","last_undegraded":"2024-09-16T07:50:14.352001+0000","last_fullsized":"2024-09-16T07:50:14.352001+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:48:55.295023+0000","last_clean_scrub_stamp":"2024-09-16T07:48:55.295023+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":792,"num_write_kb":6336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":145,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-16T07:49:26.941284+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:49:26.941284+0000","last_peered":"2024-09-16T07:49:26.941284+0000","last_clean":"2024-09-16T07:49:26.941284+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:49:26.941284+0000","last_undegraded":"2024-09-16T07:49:26.941284+0000","last_fullsized":"2024-09-16T07:49:26.941284+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":16,"stat_sum":{"num_bytes":107937792,"num_objects":1647,"num_object_clones":0,"num_object_copies":4941,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13176,"num_write_kb":105408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161882112,"data_stored":323764224,"data_compressed":16714473,"data_compressed_allocated":161882112,"data_compressed_original":323764224,"omap_allocated":0,"internal_metadata":0},"log_size":13176,"ondisk_log_size":13176,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143716,"kb_used_data":40532,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94228124,"statfs":{"total":96636764160,"available":96489598976,"internally_reserved":0,"allocated":41504768,"data_stored":82196390,"data_compressed":4234285,"data_compressed_allocated":41009152,"data_compressed_original":82018304,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706292,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":156656,"kb_used_data":45152,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94215184,"statfs":{"total":96636764160,"available":96476348416,"internally_reserved":0,"allocated":46235648,"data_stored":92125638,"data_compressed":4746351,"data_compressed_allocated":45719552,"data_compressed_original":91930624,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137784,"kb_used_data":30440,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94234056,"statfs":{"total":96636764160,"available":96495673344,"internally_reserved":0,"allocated":31170560,"data_stored":61995462,"data_compressed":3190914,"data_compressed_allocated":30654464,"data_compressed_original":61800448,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":159204,"kb_used_data":43540,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94212636,"statfs":{"total":96636764160,"available":96473739264,"internally_reserved":0,"allocated":44584960,"data_stored":88832435,"data_compressed":4576352,"data_compressed_allocated":44072960,"data_compressed_original":88637440,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44068864,"data_stored":88137728,"data_compressed":4550122,"data_compressed_allocated":44068864,"data_compressed_original":88137728,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30638080,"data_stored":61276160,"data_compressed":3163415,"data_compressed_allocated":30638080,"data_compressed_original":61276160,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46125056,"data_stored":92250112,"data_compressed":4762421,"data_compressed_allocated":46125056,"data_compressed_original":92250112,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41050112,"data_stored":82100224,"data_compressed":4238515,"data_compressed_allocated":41050112,"data_compressed_original":82100224,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:50:37.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:37.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:37.531+0000 7fdce2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:37.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:37.540+0000 7fdce2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:39.121 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Removed 1883 objects 2024-09-16T07:50:39.122 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Clean up completed and total clean up time :10.694 2024-09-16T07:50:39.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:39.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:39.933+0000 7f9878488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:39.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:39.938+0000 7f9878488640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:41.053 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_5 2024-09-16T07:50:41.053 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_5 unique_pool_5 --yes-i-really-really-mean-it 2024-09-16T07:50:41.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:41.161+0000 7f83d2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:41.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:41.173+0000 7f83d2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:41.890 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_5' removed 2024-09-16T07:50:41.910 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:50:41.911 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:50:41.911 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_6 2024-09-16T07:50:41.912 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_6 16 2024-09-16T07:50:42.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:42.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.078+0000 7f362acfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.096+0000 7f362acfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.176 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:42.176 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:42.176 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:50:42.176 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:50:42.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.186+0000 7f91b4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.193+0000 7f91b4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.291+0000 7f41cb151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.300+0000 7f41cb151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.317 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:42.318 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:42.320 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:42.321 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:42.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:50:42.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.478+0000 7fcbe9711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.487+0000 7fcbe9711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.501 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:42.502 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:42.504 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:42.505 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:42.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:50:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.610+0000 7feeb8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.619+0000 7feeb8d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.634 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:42.634 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:42.634 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:42.634 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:42.634 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:42.634 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:42.634 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:42.635 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:42.635 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:42.635 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:42.635 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:42.635 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:42.636 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:42.637 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:42.637 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:50:42.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.743+0000 7f004d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:42.752+0000 7f004d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:42.767 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:42.768 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:42.770 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:42.770 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:42.890 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_6' created 2024-09-16T07:50:42.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_6 rados --yes-i-really-mean-it || true 2024-09-16T07:50:43.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:43.030+0000 7f87accd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:43.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:43.044+0000 7f87accd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:43.898 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_6' 2024-09-16T07:50:44.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:44.440+0000 7fa6cdd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:44.445+0000 7fa6cdd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:44.917 DEBUG:teuthology.orchestra.run.smithi137:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_6 bench 90 write' 2024-09-16T07:50:44.920 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:50:44.920 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:50:44.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:hints = 1 2024-09-16T07:50:44.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:50:44.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object prefix: benchmark_data_smithi137_57051 2024-09-16T07:50:44.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:50:44.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:50:45.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 1 16 192 176 1.37492 1.375 0.0812971 0.0881594 2024-09-16T07:50:46.541 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:46.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:46.696+0000 7fdac5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:46.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:46.703+0000 7fdac5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:46.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 2 16 368 352 1.3749 1.375 0.189358 0.0868186 2024-09-16T07:50:47.771 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:47.771 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:47.772 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:50:47.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:47.915+0000 7f56bfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:47.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:47.925+0000 7f56bfd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:47.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 3 16 568 552 1.43739 1.5625 0.0735464 0.0853945 2024-09-16T07:50:48.237 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:50:48.238 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:50:48.255 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-09-16T07:50:47.825951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":489904,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376997456,"statfs":{"total":386547056640,"available":386045394944,"internally_reserved":0,"allocated":2277376,"data_stored":2525437,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.934687"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.062502+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:50:44.062502+0000","last_peered":"2024-09-16T07:50:44.062502+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:50:44.062502+0000","last_undegraded":"2024-09-16T07:50:44.062502+0000","last_fullsized":"2024-09-16T07:50:44.062502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.049982+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:50:44.049982+0000","last_peered":"2024-09-16T07:50:44.049982+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:50:44.049982+0000","last_undegraded":"2024-09-16T07:50:44.049982+0000","last_fullsized":"2024-09-16T07:50:44.049982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.024546+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:50:44.024546+0000","last_peered":"2024-09-16T07:50:44.024546+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:50:44.024546+0000","last_undegraded":"2024-09-16T07:50:44.024546+0000","last_fullsized":"2024-09-16T07:50:44.024546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.131196+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:50:44.131196+0000","last_peered":"2024-09-16T07:50:44.131196+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:50:44.131196+0000","last_undegraded":"2024-09-16T07:50:44.131196+0000","last_fullsized":"2024-09-16T07:50:44.131196+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.056710+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:50:44.056710+0000","last_peered":"2024-09-16T07:50:44.056710+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:50:44.056710+0000","last_undegraded":"2024-09-16T07:50:44.056710+0000","last_fullsized":"2024-09-16T07:50:44.056710+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.072868+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:50:44.072868+0000","last_peered":"2024-09-16T07:50:44.072868+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:50:44.072868+0000","last_undegraded":"2024-09-16T07:50:44.072868+0000","last_fullsized":"2024-09-16T07:50:44.072868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.011939+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:50:44.011939+0000","last_peered":"2024-09-16T07:50:44.011939+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:50:44.011939+0000","last_undegraded":"2024-09-16T07:50:44.011939+0000","last_fullsized":"2024-09-16T07:50:44.011939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.036042+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:50:44.036042+0000","last_peered":"2024-09-16T07:50:44.036042+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:50:44.036042+0000","last_undegraded":"2024-09-16T07:50:44.036042+0000","last_fullsized":"2024-09-16T07:50:44.036042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.051607+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:50:44.051607+0000","last_peered":"2024-09-16T07:50:44.051607+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:50:44.051607+0000","last_undegraded":"2024-09-16T07:50:44.051607+0000","last_fullsized":"2024-09-16T07:50:44.051607+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.924207+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:50:43.924207+0000","last_peered":"2024-09-16T07:50:43.924207+0000","last_clean":"2024-09-16T07:50:43.924207+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:50:43.924207+0000","last_undegraded":"2024-09-16T07:50:43.924207+0000","last_fullsized":"2024-09-16T07:50:43.924207+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":155,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.918587+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:50:43.918587+0000","last_peered":"2024-09-16T07:50:43.918587+0000","last_clean":"2024-09-16T07:50:43.918587+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:50:43.918587+0000","last_undegraded":"2024-09-16T07:50:43.918587+0000","last_fullsized":"2024-09-16T07:50:43.918587+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.091013+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:50:44.091013+0000","last_peered":"2024-09-16T07:50:44.091013+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:50:44.091013+0000","last_undegraded":"2024-09-16T07:50:44.091013+0000","last_fullsized":"2024-09-16T07:50:44.091013+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.911510+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:50:43.911510+0000","last_peered":"2024-09-16T07:50:43.911510+0000","last_clean":"2024-09-16T07:50:43.911510+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:50:43.911510+0000","last_undegraded":"2024-09-16T07:50:43.911510+0000","last_fullsized":"2024-09-16T07:50:43.911510+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.029615+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:50:44.029615+0000","last_peered":"2024-09-16T07:50:44.029615+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:50:44.029615+0000","last_undegraded":"2024-09-16T07:50:44.029615+0000","last_fullsized":"2024-09-16T07:50:44.029615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.931301+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:50:43.931301+0000","last_peered":"2024-09-16T07:50:43.931301+0000","last_clean":"2024-09-16T07:50:43.931301+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:50:43.931301+0000","last_undegraded":"2024-09-16T07:50:43.931301+0000","last_fullsized":"2024-09-16T07:50:43.931301+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.076188+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:50:44.076188+0000","last_peered":"2024-09-16T07:50:44.076188+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:50:44.076188+0000","last_undegraded":"2024-09-16T07:50:44.076188+0000","last_fullsized":"2024-09-16T07:50:44.076188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.922965+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:50:43.922965+0000","last_peered":"2024-09-16T07:50:43.922965+0000","last_clean":"2024-09-16T07:50:43.922965+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:50:43.922965+0000","last_undegraded":"2024-09-16T07:50:43.922965+0000","last_fullsized":"2024-09-16T07:50:43.922965+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.112007+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:50:44.112007+0000","last_peered":"2024-09-16T07:50:44.112007+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:50:44.112007+0000","last_undegraded":"2024-09-16T07:50:44.112007+0000","last_fullsized":"2024-09-16T07:50:44.112007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.929419+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:50:43.929419+0000","last_peered":"2024-09-16T07:50:43.929419+0000","last_clean":"2024-09-16T07:50:43.929419+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:50:43.929419+0000","last_undegraded":"2024-09-16T07:50:43.929419+0000","last_fullsized":"2024-09-16T07:50:43.929419+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.085555+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:50:44.085555+0000","last_peered":"2024-09-16T07:50:44.085555+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:50:44.085555+0000","last_undegraded":"2024-09-16T07:50:44.085555+0000","last_fullsized":"2024-09-16T07:50:44.085555+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.928703+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:50:43.928703+0000","last_peered":"2024-09-16T07:50:43.928703+0000","last_clean":"2024-09-16T07:50:43.928703+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:50:43.928703+0000","last_undegraded":"2024-09-16T07:50:43.928703+0000","last_fullsized":"2024-09-16T07:50:43.928703+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.055872+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:50:44.055872+0000","last_peered":"2024-09-16T07:50:44.055872+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:50:44.055872+0000","last_undegraded":"2024-09-16T07:50:44.055872+0000","last_fullsized":"2024-09-16T07:50:44.055872+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.915627+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:50:43.915627+0000","last_peered":"2024-09-16T07:50:43.915627+0000","last_clean":"2024-09-16T07:50:43.915627+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:50:43.915627+0000","last_undegraded":"2024-09-16T07:50:43.915627+0000","last_fullsized":"2024-09-16T07:50:43.915627+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.048634+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:50:44.048634+0000","last_peered":"2024-09-16T07:50:44.048634+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:50:44.048634+0000","last_undegraded":"2024-09-16T07:50:44.048634+0000","last_fullsized":"2024-09-16T07:50:44.048634+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.912040+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:50:43.912040+0000","last_peered":"2024-09-16T07:50:43.912040+0000","last_clean":"2024-09-16T07:50:43.912040+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:50:43.912040+0000","last_undegraded":"2024-09-16T07:50:43.912040+0000","last_fullsized":"2024-09-16T07:50:43.912040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130064,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241776,"statfs":{"total":96636764160,"available":96503578624,"internally_reserved":0,"allocated":524288,"data_stored":188588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130124,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241716,"statfs":{"total":96636764160,"available":96503517184,"internally_reserved":0,"allocated":585728,"data_stored":778956,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99596,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272244,"statfs":{"total":96636764160,"available":96534777856,"internally_reserved":0,"allocated":585728,"data_stored":778956,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130120,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241720,"statfs":{"total":96636764160,"available":96503521280,"internally_reserved":0,"allocated":581632,"data_stored":778937,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:50:48.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 4 16 734 718 1.40223 1.29688 0.096812 0.0878489 2024-09-16T07:50:48.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:49.126+0000 7f6bb64d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:49.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:49.133+0000 7f6bb64d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:49.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 5 16 903 887 1.38583 1.32031 0.136274 0.0886584 2024-09-16T07:50:50.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 6 16 1084 1068 1.39052 1.41406 0.0849398 0.0892418 2024-09-16T07:50:51.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:51.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:51.734+0000 7f52e3511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:51.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:51.742+0000 7f52e3511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:51.986 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 7 16 1258 1242 1.38605 1.35938 0.13157 0.0892717 2024-09-16T07:50:52.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 8 16 1442 1426 1.39247 1.4375 0.11124 0.0890689 2024-09-16T07:50:53.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:53.258 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:53.258 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:50:53.258 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:50:53.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:53.412+0000 7f00b54d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:53.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:53.428+0000 7f00b54d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:53.458 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:53.459 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:53.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:53.463 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:53.463 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:50:53.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:53.616+0000 7ff026d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:53.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:53.631+0000 7ff026d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:53.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:53.822 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:53.822 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:50:53.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 9 16 1613 1597 1.38617 1.33594 0.0927671 0.0893613 2024-09-16T07:50:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:53.978+0000 7f72aff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:53.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:53.995+0000 7f72aff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:54.018 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:54.018 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:54.018 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:54.018 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:54.018 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:54.019 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:54.019 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:54.019 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:54.019 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:54.019 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:54.019 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:54.019 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:54.022 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:54.023 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:54.023 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:50:54.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:54.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:54.162+0000 7ff804151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:54.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:54.174+0000 7ff804151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:54.201 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:54.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:54.202 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:54.204 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:54.205 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:54.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:54.227+0000 7fd491d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:54.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:54.235+0000 7fd491d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:54.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 10 16 1777 1761 1.37567 1.28125 0.0334875 0.0903643 2024-09-16T07:50:55.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 11 16 1948 1932 1.37205 1.33594 0.107568 0.0905732 2024-09-16T07:50:56.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:50:56.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:56.659+0000 7f9a0db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:56.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:56.667+0000 7f9a0db91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:56.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 12 16 2138 2122 1.3814 1.48438 0.0452499 0.0900725 2024-09-16T07:50:57.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 13 16 2317 2301 1.3827 1.39844 0.0514441 0.0902193 2024-09-16T07:50:58.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 14 16 2489 2473 1.37991 1.34375 0.0562287 0.090216 2024-09-16T07:50:59.025 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:50:59.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:59.154+0000 7f74a6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:59.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:59.161+0000 7f74a6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:59.206 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:50:59.206 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:50:59.206 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:50:59.206 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:50:59.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:59.347+0000 7f31cdd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:59.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:59.359+0000 7f31cdd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:59.403 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:59.403 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:59.403 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:59.403 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:59.404 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:59.404 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:59.404 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:59.404 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:59.404 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:59.404 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:59.404 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:59.404 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:59.407 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:59.407 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:59.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:50:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:59.539+0000 7f88e2511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:59.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:59.550+0000 7f88e2511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:59.706 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:59.707 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:59.707 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:59.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:59.709 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:59.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:50:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:59.841+0000 7f97c4646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:50:59.854+0000 7f97c4646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:50:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:50:59.880 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:50:59.880 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:50:59.882 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:50:59.883 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:50:59.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:50:59.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 15 16 2654 2638 1.37385 1.28906 0.121583 0.0906081 2024-09-16T07:51:00.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:00.009+0000 7fc0f7348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:00.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:00.021+0000 7fc0f7348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:00.054 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:00.054 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:00.054 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:00.054 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:00.054 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:00.055 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:00.055 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:00.055 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:00.055 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:00.055 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:00.055 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:00.055 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:00.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:00.059 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:00.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 16 16 2827 2811 1.37245 1.35156 0.109087 0.0907434 2024-09-16T07:51:01.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:01.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:01.582+0000 7f5172751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:01.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:01.588+0000 7f5172751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:01.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 17 16 3015 2999 1.3781 1.46875 0.115553 0.0904265 2024-09-16T07:51:02.987 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 18 16 3195 3179 1.37966 1.40625 0.102695 0.0902474 2024-09-16T07:51:03.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 19 16 3359 3343 1.37448 1.28125 0.106439 0.0907397 2024-09-16T07:51:03.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:04.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:04.155+0000 7f7093ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:04.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:04.163+0000 7f7093ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:04.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:51:04.989623+0000 min lat: 0.0152416 max lat: 0.232935 avg lat: 0.0903004 2024-09-16T07:51:04.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:51:04.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 20 16 3552 3536 1.38114 1.50781 0.076892 0.0903004 2024-09-16T07:51:05.060 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:51:05.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:51:05.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:05.194+0000 7f4f93791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:05.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:05.212+0000 7f4f93791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:05.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 21 16 3726 3710 1.38009 1.35938 0.0851973 0.0903171 2024-09-16T07:51:06.321 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:51:06.342 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:51:06.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:06.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:06.482+0000 7fec6cd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:06.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:06.500+0000 7fec6cd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:06.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:06.574+0000 7fd7a6a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:06.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:06.582+0000 7fd7a6a93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:06.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 22 16 3896 3880 1.37772 1.32812 0.0758573 0.0905644 2024-09-16T07:51:07.326 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:51:07.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:51:07.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:07.490+0000 7f5859391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:07.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:07.502+0000 7f5859391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:07.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 23 16 4074 4058 1.37828 1.39062 0.0864237 0.0904932 2024-09-16T07:51:08.338 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:51:08.359 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:51:08.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:08.490+0000 7fe3b5551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:08.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:08.505+0000 7fe3b5551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:08.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 24 16 4238 4222 1.37423 1.28125 0.0426601 0.0907151 2024-09-16T07:51:09.090 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:09.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:09.226+0000 7f33be391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:09.235+0000 7f33be391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:09.339 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:51:09.358 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:51:09.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:09.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:09.511+0000 7fb83b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:09.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:09.519+0000 7fb83b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:09.757 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:51:09.757 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:51:09.780 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-16T07:51:09.341730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":489904,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376997456,"statfs":{"total":386547056640,"available":386045394944,"internally_reserved":0,"allocated":2277376,"data_stored":2525437,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.512633"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.062502+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:50:44.062502+0000","last_peered":"2024-09-16T07:50:44.062502+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:50:44.062502+0000","last_undegraded":"2024-09-16T07:50:44.062502+0000","last_fullsized":"2024-09-16T07:50:44.062502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.049982+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:50:44.049982+0000","last_peered":"2024-09-16T07:50:44.049982+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:50:44.049982+0000","last_undegraded":"2024-09-16T07:50:44.049982+0000","last_fullsized":"2024-09-16T07:50:44.049982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.024546+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:50:44.024546+0000","last_peered":"2024-09-16T07:50:44.024546+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:50:44.024546+0000","last_undegraded":"2024-09-16T07:50:44.024546+0000","last_fullsized":"2024-09-16T07:50:44.024546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.131196+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:50:44.131196+0000","last_peered":"2024-09-16T07:50:44.131196+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:50:44.131196+0000","last_undegraded":"2024-09-16T07:50:44.131196+0000","last_fullsized":"2024-09-16T07:50:44.131196+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.056710+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:50:44.056710+0000","last_peered":"2024-09-16T07:50:44.056710+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:50:44.056710+0000","last_undegraded":"2024-09-16T07:50:44.056710+0000","last_fullsized":"2024-09-16T07:50:44.056710+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.072868+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:50:44.072868+0000","last_peered":"2024-09-16T07:50:44.072868+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:50:44.072868+0000","last_undegraded":"2024-09-16T07:50:44.072868+0000","last_fullsized":"2024-09-16T07:50:44.072868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.011939+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:50:44.011939+0000","last_peered":"2024-09-16T07:50:44.011939+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:50:44.011939+0000","last_undegraded":"2024-09-16T07:50:44.011939+0000","last_fullsized":"2024-09-16T07:50:44.011939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.036042+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:50:44.036042+0000","last_peered":"2024-09-16T07:50:44.036042+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:50:44.036042+0000","last_undegraded":"2024-09-16T07:50:44.036042+0000","last_fullsized":"2024-09-16T07:50:44.036042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.051607+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:50:44.051607+0000","last_peered":"2024-09-16T07:50:44.051607+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:50:44.051607+0000","last_undegraded":"2024-09-16T07:50:44.051607+0000","last_fullsized":"2024-09-16T07:50:44.051607+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.924207+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:50:43.924207+0000","last_peered":"2024-09-16T07:50:43.924207+0000","last_clean":"2024-09-16T07:50:43.924207+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:50:43.924207+0000","last_undegraded":"2024-09-16T07:50:43.924207+0000","last_fullsized":"2024-09-16T07:50:43.924207+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":155,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.918587+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:50:43.918587+0000","last_peered":"2024-09-16T07:50:43.918587+0000","last_clean":"2024-09-16T07:50:43.918587+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:50:43.918587+0000","last_undegraded":"2024-09-16T07:50:43.918587+0000","last_fullsized":"2024-09-16T07:50:43.918587+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.091013+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:50:44.091013+0000","last_peered":"2024-09-16T07:50:44.091013+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:50:44.091013+0000","last_undegraded":"2024-09-16T07:50:44.091013+0000","last_fullsized":"2024-09-16T07:50:44.091013+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.911510+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:50:43.911510+0000","last_peered":"2024-09-16T07:50:43.911510+0000","last_clean":"2024-09-16T07:50:43.911510+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:50:43.911510+0000","last_undegraded":"2024-09-16T07:50:43.911510+0000","last_fullsized":"2024-09-16T07:50:43.911510+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.029615+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:50:44.029615+0000","last_peered":"2024-09-16T07:50:44.029615+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:50:44.029615+0000","last_undegraded":"2024-09-16T07:50:44.029615+0000","last_fullsized":"2024-09-16T07:50:44.029615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.931301+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:50:43.931301+0000","last_peered":"2024-09-16T07:50:43.931301+0000","last_clean":"2024-09-16T07:50:43.931301+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:50:43.931301+0000","last_undegraded":"2024-09-16T07:50:43.931301+0000","last_fullsized":"2024-09-16T07:50:43.931301+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.076188+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:50:44.076188+0000","last_peered":"2024-09-16T07:50:44.076188+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:50:44.076188+0000","last_undegraded":"2024-09-16T07:50:44.076188+0000","last_fullsized":"2024-09-16T07:50:44.076188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.922965+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:50:43.922965+0000","last_peered":"2024-09-16T07:50:43.922965+0000","last_clean":"2024-09-16T07:50:43.922965+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:50:43.922965+0000","last_undegraded":"2024-09-16T07:50:43.922965+0000","last_fullsized":"2024-09-16T07:50:43.922965+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.112007+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:50:44.112007+0000","last_peered":"2024-09-16T07:50:44.112007+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:50:44.112007+0000","last_undegraded":"2024-09-16T07:50:44.112007+0000","last_fullsized":"2024-09-16T07:50:44.112007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.929419+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:50:43.929419+0000","last_peered":"2024-09-16T07:50:43.929419+0000","last_clean":"2024-09-16T07:50:43.929419+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:50:43.929419+0000","last_undegraded":"2024-09-16T07:50:43.929419+0000","last_fullsized":"2024-09-16T07:50:43.929419+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.085555+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:50:44.085555+0000","last_peered":"2024-09-16T07:50:44.085555+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:50:44.085555+0000","last_undegraded":"2024-09-16T07:50:44.085555+0000","last_fullsized":"2024-09-16T07:50:44.085555+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.928703+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:50:43.928703+0000","last_peered":"2024-09-16T07:50:43.928703+0000","last_clean":"2024-09-16T07:50:43.928703+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:50:43.928703+0000","last_undegraded":"2024-09-16T07:50:43.928703+0000","last_fullsized":"2024-09-16T07:50:43.928703+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.055872+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:50:44.055872+0000","last_peered":"2024-09-16T07:50:44.055872+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:50:44.055872+0000","last_undegraded":"2024-09-16T07:50:44.055872+0000","last_fullsized":"2024-09-16T07:50:44.055872+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.915627+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:50:43.915627+0000","last_peered":"2024-09-16T07:50:43.915627+0000","last_clean":"2024-09-16T07:50:43.915627+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:50:43.915627+0000","last_undegraded":"2024-09-16T07:50:43.915627+0000","last_fullsized":"2024-09-16T07:50:43.915627+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.048634+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:50:44.048634+0000","last_peered":"2024-09-16T07:50:44.048634+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:50:44.048634+0000","last_undegraded":"2024-09-16T07:50:44.048634+0000","last_fullsized":"2024-09-16T07:50:44.048634+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.912040+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:50:43.912040+0000","last_peered":"2024-09-16T07:50:43.912040+0000","last_clean":"2024-09-16T07:50:43.912040+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:50:43.912040+0000","last_undegraded":"2024-09-16T07:50:43.912040+0000","last_fullsized":"2024-09-16T07:50:43.912040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130064,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241776,"statfs":{"total":96636764160,"available":96503578624,"internally_reserved":0,"allocated":524288,"data_stored":188588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130124,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241716,"statfs":{"total":96636764160,"available":96503517184,"internally_reserved":0,"allocated":585728,"data_stored":778956,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99596,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272244,"statfs":{"total":96636764160,"available":96534777856,"internally_reserved":0,"allocated":585728,"data_stored":778956,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130120,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241720,"statfs":{"total":96636764160,"available":96503521280,"internally_reserved":0,"allocated":581632,"data_stored":778937,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:09.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:09.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:09.947+0000 7f42afb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:09.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:09.959+0000 7f42afb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:09.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 25 16 4416 4400 1.37488 1.39062 0.135052 0.0907682 2024-09-16T07:51:10.209 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:51:10.210 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:51:10.229 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-09-16T07:51:09.830244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":489904,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376997456,"statfs":{"total":386547056640,"available":386045394944,"internally_reserved":0,"allocated":2277376,"data_stored":2525437,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000736"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.062502+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:50:44.062502+0000","last_peered":"2024-09-16T07:50:44.062502+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:50:44.062502+0000","last_undegraded":"2024-09-16T07:50:44.062502+0000","last_fullsized":"2024-09-16T07:50:44.062502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.049982+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:50:44.049982+0000","last_peered":"2024-09-16T07:50:44.049982+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:50:44.049982+0000","last_undegraded":"2024-09-16T07:50:44.049982+0000","last_fullsized":"2024-09-16T07:50:44.049982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.024546+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:50:44.024546+0000","last_peered":"2024-09-16T07:50:44.024546+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:50:44.024546+0000","last_undegraded":"2024-09-16T07:50:44.024546+0000","last_fullsized":"2024-09-16T07:50:44.024546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.131196+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:50:44.131196+0000","last_peered":"2024-09-16T07:50:44.131196+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:50:44.131196+0000","last_undegraded":"2024-09-16T07:50:44.131196+0000","last_fullsized":"2024-09-16T07:50:44.131196+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.056710+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:50:44.056710+0000","last_peered":"2024-09-16T07:50:44.056710+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:50:44.056710+0000","last_undegraded":"2024-09-16T07:50:44.056710+0000","last_fullsized":"2024-09-16T07:50:44.056710+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.072868+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:50:44.072868+0000","last_peered":"2024-09-16T07:50:44.072868+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:50:44.072868+0000","last_undegraded":"2024-09-16T07:50:44.072868+0000","last_fullsized":"2024-09-16T07:50:44.072868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.011939+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:50:44.011939+0000","last_peered":"2024-09-16T07:50:44.011939+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:50:44.011939+0000","last_undegraded":"2024-09-16T07:50:44.011939+0000","last_fullsized":"2024-09-16T07:50:44.011939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.036042+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:50:44.036042+0000","last_peered":"2024-09-16T07:50:44.036042+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:50:44.036042+0000","last_undegraded":"2024-09-16T07:50:44.036042+0000","last_fullsized":"2024-09-16T07:50:44.036042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.051607+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:50:44.051607+0000","last_peered":"2024-09-16T07:50:44.051607+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:50:44.051607+0000","last_undegraded":"2024-09-16T07:50:44.051607+0000","last_fullsized":"2024-09-16T07:50:44.051607+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.924207+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:50:43.924207+0000","last_peered":"2024-09-16T07:50:43.924207+0000","last_clean":"2024-09-16T07:50:43.924207+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:50:43.924207+0000","last_undegraded":"2024-09-16T07:50:43.924207+0000","last_fullsized":"2024-09-16T07:50:43.924207+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":155,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.918587+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:50:43.918587+0000","last_peered":"2024-09-16T07:50:43.918587+0000","last_clean":"2024-09-16T07:50:43.918587+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:50:43.918587+0000","last_undegraded":"2024-09-16T07:50:43.918587+0000","last_fullsized":"2024-09-16T07:50:43.918587+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.091013+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:50:44.091013+0000","last_peered":"2024-09-16T07:50:44.091013+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:50:44.091013+0000","last_undegraded":"2024-09-16T07:50:44.091013+0000","last_fullsized":"2024-09-16T07:50:44.091013+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.911510+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:50:43.911510+0000","last_peered":"2024-09-16T07:50:43.911510+0000","last_clean":"2024-09-16T07:50:43.911510+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:50:43.911510+0000","last_undegraded":"2024-09-16T07:50:43.911510+0000","last_fullsized":"2024-09-16T07:50:43.911510+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.029615+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:50:44.029615+0000","last_peered":"2024-09-16T07:50:44.029615+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:50:44.029615+0000","last_undegraded":"2024-09-16T07:50:44.029615+0000","last_fullsized":"2024-09-16T07:50:44.029615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.931301+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:50:43.931301+0000","last_peered":"2024-09-16T07:50:43.931301+0000","last_clean":"2024-09-16T07:50:43.931301+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:50:43.931301+0000","last_undegraded":"2024-09-16T07:50:43.931301+0000","last_fullsized":"2024-09-16T07:50:43.931301+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.076188+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:50:44.076188+0000","last_peered":"2024-09-16T07:50:44.076188+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:50:44.076188+0000","last_undegraded":"2024-09-16T07:50:44.076188+0000","last_fullsized":"2024-09-16T07:50:44.076188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.922965+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:50:43.922965+0000","last_peered":"2024-09-16T07:50:43.922965+0000","last_clean":"2024-09-16T07:50:43.922965+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:50:43.922965+0000","last_undegraded":"2024-09-16T07:50:43.922965+0000","last_fullsized":"2024-09-16T07:50:43.922965+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.112007+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:50:44.112007+0000","last_peered":"2024-09-16T07:50:44.112007+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:50:44.112007+0000","last_undegraded":"2024-09-16T07:50:44.112007+0000","last_fullsized":"2024-09-16T07:50:44.112007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.929419+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:50:43.929419+0000","last_peered":"2024-09-16T07:50:43.929419+0000","last_clean":"2024-09-16T07:50:43.929419+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:50:43.929419+0000","last_undegraded":"2024-09-16T07:50:43.929419+0000","last_fullsized":"2024-09-16T07:50:43.929419+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.085555+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:50:44.085555+0000","last_peered":"2024-09-16T07:50:44.085555+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:50:44.085555+0000","last_undegraded":"2024-09-16T07:50:44.085555+0000","last_fullsized":"2024-09-16T07:50:44.085555+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.928703+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:50:43.928703+0000","last_peered":"2024-09-16T07:50:43.928703+0000","last_clean":"2024-09-16T07:50:43.928703+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:50:43.928703+0000","last_undegraded":"2024-09-16T07:50:43.928703+0000","last_fullsized":"2024-09-16T07:50:43.928703+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.055872+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:50:44.055872+0000","last_peered":"2024-09-16T07:50:44.055872+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:50:44.055872+0000","last_undegraded":"2024-09-16T07:50:44.055872+0000","last_fullsized":"2024-09-16T07:50:44.055872+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.915627+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:50:43.915627+0000","last_peered":"2024-09-16T07:50:43.915627+0000","last_clean":"2024-09-16T07:50:43.915627+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:50:43.915627+0000","last_undegraded":"2024-09-16T07:50:43.915627+0000","last_fullsized":"2024-09-16T07:50:43.915627+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.048634+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:50:44.048634+0000","last_peered":"2024-09-16T07:50:44.048634+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:50:44.048634+0000","last_undegraded":"2024-09-16T07:50:44.048634+0000","last_fullsized":"2024-09-16T07:50:44.048634+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.912040+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:50:43.912040+0000","last_peered":"2024-09-16T07:50:43.912040+0000","last_clean":"2024-09-16T07:50:43.912040+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:50:43.912040+0000","last_undegraded":"2024-09-16T07:50:43.912040+0000","last_fullsized":"2024-09-16T07:50:43.912040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130064,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241776,"statfs":{"total":96636764160,"available":96503578624,"internally_reserved":0,"allocated":524288,"data_stored":188588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130124,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241716,"statfs":{"total":96636764160,"available":96503517184,"internally_reserved":0,"allocated":585728,"data_stored":778956,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99596,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272244,"statfs":{"total":96636764160,"available":96534777856,"internally_reserved":0,"allocated":585728,"data_stored":778956,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130120,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241720,"statfs":{"total":96636764160,"available":96503521280,"internally_reserved":0,"allocated":581632,"data_stored":778937,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:10.230 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:51:10.230 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:51:10.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:10.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:10.365+0000 7f7b70791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:10.376+0000 7f7b70791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:10.641 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:51:10.642 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:51:10.657 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-09-16T07:51:09.830244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":489904,"kb_used_data":2224,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376997456,"statfs":{"total":386547056640,"available":386045394944,"internally_reserved":0,"allocated":2277376,"data_stored":2525437,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000736"},"pg_stats":[{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.062502+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:50:44.062502+0000","last_peered":"2024-09-16T07:50:44.062502+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:50:44.062502+0000","last_undegraded":"2024-09-16T07:50:44.062502+0000","last_fullsized":"2024-09-16T07:50:44.062502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.049982+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:50:44.049982+0000","last_peered":"2024-09-16T07:50:44.049982+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:50:44.049982+0000","last_undegraded":"2024-09-16T07:50:44.049982+0000","last_fullsized":"2024-09-16T07:50:44.049982+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.024546+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:50:44.024546+0000","last_peered":"2024-09-16T07:50:44.024546+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:50:44.024546+0000","last_undegraded":"2024-09-16T07:50:44.024546+0000","last_fullsized":"2024-09-16T07:50:44.024546+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.131196+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:50:44.131196+0000","last_peered":"2024-09-16T07:50:44.131196+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:50:44.131196+0000","last_undegraded":"2024-09-16T07:50:44.131196+0000","last_fullsized":"2024-09-16T07:50:44.131196+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.056710+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:50:44.056710+0000","last_peered":"2024-09-16T07:50:44.056710+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:50:44.056710+0000","last_undegraded":"2024-09-16T07:50:44.056710+0000","last_fullsized":"2024-09-16T07:50:44.056710+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.072868+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:50:44.072868+0000","last_peered":"2024-09-16T07:50:44.072868+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:50:44.072868+0000","last_undegraded":"2024-09-16T07:50:44.072868+0000","last_fullsized":"2024-09-16T07:50:44.072868+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.011939+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:50:44.011939+0000","last_peered":"2024-09-16T07:50:44.011939+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:50:44.011939+0000","last_undegraded":"2024-09-16T07:50:44.011939+0000","last_fullsized":"2024-09-16T07:50:44.011939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.036042+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:50:44.036042+0000","last_peered":"2024-09-16T07:50:44.036042+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:50:44.036042+0000","last_undegraded":"2024-09-16T07:50:44.036042+0000","last_fullsized":"2024-09-16T07:50:44.036042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.051607+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:50:44.051607+0000","last_peered":"2024-09-16T07:50:44.051607+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:50:44.051607+0000","last_undegraded":"2024-09-16T07:50:44.051607+0000","last_fullsized":"2024-09-16T07:50:44.051607+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":223,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.924207+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:50:43.924207+0000","last_peered":"2024-09-16T07:50:43.924207+0000","last_clean":"2024-09-16T07:50:43.924207+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:50:43.924207+0000","last_undegraded":"2024-09-16T07:50:43.924207+0000","last_fullsized":"2024-09-16T07:50:43.924207+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":155,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.918587+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:50:43.918587+0000","last_peered":"2024-09-16T07:50:43.918587+0000","last_clean":"2024-09-16T07:50:43.918587+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:50:43.918587+0000","last_undegraded":"2024-09-16T07:50:43.918587+0000","last_fullsized":"2024-09-16T07:50:43.918587+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.091013+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:50:44.091013+0000","last_peered":"2024-09-16T07:50:44.091013+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:50:44.091013+0000","last_undegraded":"2024-09-16T07:50:44.091013+0000","last_fullsized":"2024-09-16T07:50:44.091013+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.911510+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:50:43.911510+0000","last_peered":"2024-09-16T07:50:43.911510+0000","last_clean":"2024-09-16T07:50:43.911510+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:50:43.911510+0000","last_undegraded":"2024-09-16T07:50:43.911510+0000","last_fullsized":"2024-09-16T07:50:43.911510+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.029615+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:50:44.029615+0000","last_peered":"2024-09-16T07:50:44.029615+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:50:44.029615+0000","last_undegraded":"2024-09-16T07:50:44.029615+0000","last_fullsized":"2024-09-16T07:50:44.029615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.931301+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:50:43.931301+0000","last_peered":"2024-09-16T07:50:43.931301+0000","last_clean":"2024-09-16T07:50:43.931301+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:50:43.931301+0000","last_undegraded":"2024-09-16T07:50:43.931301+0000","last_fullsized":"2024-09-16T07:50:43.931301+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.076188+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:50:44.076188+0000","last_peered":"2024-09-16T07:50:44.076188+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:50:44.076188+0000","last_undegraded":"2024-09-16T07:50:44.076188+0000","last_fullsized":"2024-09-16T07:50:44.076188+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":156,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.922965+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:50:43.922965+0000","last_peered":"2024-09-16T07:50:43.922965+0000","last_clean":"2024-09-16T07:50:43.922965+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:50:43.922965+0000","last_undegraded":"2024-09-16T07:50:43.922965+0000","last_fullsized":"2024-09-16T07:50:43.922965+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.112007+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:50:44.112007+0000","last_peered":"2024-09-16T07:50:44.112007+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:50:44.112007+0000","last_undegraded":"2024-09-16T07:50:44.112007+0000","last_fullsized":"2024-09-16T07:50:44.112007+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.929419+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:50:43.929419+0000","last_peered":"2024-09-16T07:50:43.929419+0000","last_clean":"2024-09-16T07:50:43.929419+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:50:43.929419+0000","last_undegraded":"2024-09-16T07:50:43.929419+0000","last_fullsized":"2024-09-16T07:50:43.929419+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.085555+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:50:44.085555+0000","last_peered":"2024-09-16T07:50:44.085555+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:50:44.085555+0000","last_undegraded":"2024-09-16T07:50:44.085555+0000","last_fullsized":"2024-09-16T07:50:44.085555+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.928703+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:50:43.928703+0000","last_peered":"2024-09-16T07:50:43.928703+0000","last_clean":"2024-09-16T07:50:43.928703+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:50:43.928703+0000","last_undegraded":"2024-09-16T07:50:43.928703+0000","last_fullsized":"2024-09-16T07:50:43.928703+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.055872+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:50:44.055872+0000","last_peered":"2024-09-16T07:50:44.055872+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:50:44.055872+0000","last_undegraded":"2024-09-16T07:50:44.055872+0000","last_fullsized":"2024-09-16T07:50:44.055872+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.915627+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:50:43.915627+0000","last_peered":"2024-09-16T07:50:43.915627+0000","last_clean":"2024-09-16T07:50:43.915627+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:50:43.915627+0000","last_undegraded":"2024-09-16T07:50:43.915627+0000","last_fullsized":"2024-09-16T07:50:43.915627+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:44.048634+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:50:44.048634+0000","last_peered":"2024-09-16T07:50:44.048634+0000","last_clean":"2024-09-16T07:50:42.890635+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:50:44.048634+0000","last_undegraded":"2024-09-16T07:50:44.048634+0000","last_fullsized":"2024-09-16T07:50:44.048634+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-16T07:50:43.912040+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:50:43.912040+0000","last_peered":"2024-09-16T07:50:43.912040+0000","last_clean":"2024-09-16T07:50:43.912040+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:50:43.912040+0000","last_undegraded":"2024-09-16T07:50:43.912040+0000","last_fullsized":"2024-09-16T07:50:43.912040+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130064,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241776,"statfs":{"total":96636764160,"available":96503578624,"internally_reserved":0,"allocated":524288,"data_stored":188588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130124,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241716,"statfs":{"total":96636764160,"available":96503517184,"internally_reserved":0,"allocated":585728,"data_stored":778956,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99596,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272244,"statfs":{"total":96636764160,"available":96534777856,"internally_reserved":0,"allocated":585728,"data_stored":778956,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706323,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130120,"kb_used_data":568,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94241720,"statfs":{"total":96636764160,"available":96503521280,"internally_reserved":0,"allocated":581632,"data_stored":778937,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:10.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 26 16 4595 4579 1.37578 1.39844 0.104336 0.0905836 2024-09-16T07:51:11.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:11.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:11.808+0000 7faff7cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:11.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:11.819+0000 7faff6a9b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:11.988 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 27 16 4780 4764 1.37836 1.44531 0.0756841 0.0905323 2024-09-16T07:51:12.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 28 16 4919 4903 1.36791 1.08594 0.109428 0.091196 2024-09-16T07:51:13.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 29 16 5083 5067 1.36492 1.28125 0.114258 0.0913839 2024-09-16T07:51:14.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:14.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:14.334+0000 7f98bdb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:14.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:14.341+0000 7f98bdb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:14.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 30 16 5266 5250 1.36707 1.42969 0.0720979 0.0912245 2024-09-16T07:51:15.659 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:51:15.659 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:51:15.659 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:51:15.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:51:15.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:15.801+0000 7f75edb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:15.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:15.813+0000 7f75edb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:15.946 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:15.947 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:15.947 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:15.947 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:15.947 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:15.947 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:15.947 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:15.947 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:15.948 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:15.948 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:15.948 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:15.948 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:15.950 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:15.951 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:15.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:51:15.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 31 16 5432 5416 1.3648 1.29688 0.0644487 0.0914249 2024-09-16T07:51:16.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:16.095+0000 7f63f3c97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:16.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:16.110+0000 7f63f3c97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:16.289 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:16.290 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:16.294 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:16.294 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:16.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:51:16.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:16.481+0000 7faebeb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:16.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:16.494+0000 7faebeb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:16.561 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:16.562 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:16.564 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:16.565 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:16.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:51:16.588 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:16.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:16.698+0000 7f9021d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:16.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:16.712+0000 7f9021d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:16.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:16.754+0000 7f51468d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:16.756 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:16.756 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:16.756 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:16.756 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:16.756 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:16.756 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:16.756 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:16.756 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:16.757 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:16.757 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:16.757 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:16.757 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:16.760 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:16.761 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:16.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:16.762+0000 7f51468d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:16.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 32 16 5577 5561 1.35755 1.13281 0.103922 0.0918508 2024-09-16T07:51:17.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 33 16 5743 5727 1.35571 1.29688 0.117712 0.0919905 2024-09-16T07:51:18.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 34 16 5923 5907 1.35719 1.40625 0.0672264 0.0919545 2024-09-16T07:51:19.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:19.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:19.266+0000 7f412fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:19.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:19.273+0000 7f412fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:19.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 35 16 6083 6067 1.35412 1.25 0.117853 0.092159 2024-09-16T07:51:20.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 36 16 6241 6225 1.35079 1.23438 0.0673872 0.092415 2024-09-16T07:51:21.501 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:21.636+0000 7f0f55f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:21.645+0000 7f0f55f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:21.762 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:51:21.762 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:51:21.762 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:51:21.762 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:51:21.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:21.896+0000 7f8b7349c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:21.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:21.909+0000 7f8b7349c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:21.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 37 16 6413 6397 1.3506 1.34375 0.181932 0.0923125 2024-09-16T07:51:22.040 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:22.040 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:22.040 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:22.040 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:22.040 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:22.040 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:22.044 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:22.044 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:22.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:51:22.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:22.207+0000 7f6ef726c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:22.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:22.218+0000 7f6ef726c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:22.420 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:22.420 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:22.420 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:22.420 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:22.420 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:22.420 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:22.421 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:22.421 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:22.421 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:22.421 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:22.421 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:22.421 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:22.424 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:22.425 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:22.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:51:22.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:22.574+0000 7f08a165c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:22.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:22.587+0000 7f08a165c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:22.649 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:22.649 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:22.649 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:22.649 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:22.649 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:22.649 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:22.650 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:22.650 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:22.650 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:22.650 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:22.650 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:22.650 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:22.653 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:22.654 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:22.654 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:51:22.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:22.781+0000 7ff5a685c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:22.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:22.793+0000 7ff5a685c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:22.878 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:22.879 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:22.879 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:22.879 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:22.881 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:22.882 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:22.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 38 16 6578 6562 1.34898 1.28906 0.0778547 0.0925337 2024-09-16T07:51:23.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:23.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 39 16 6745 6729 1.34784 1.30469 0.0983418 0.0926152 2024-09-16T07:51:24.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:24.090+0000 7f4cf3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:24.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:24.097+0000 7f4cf3791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:24.989 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:51:24.991473+0000 min lat: 0.0152416 max lat: 0.264556 avg lat: 0.0927363 2024-09-16T07:51:24.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:51:24.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 40 16 6901 6885 1.34461 1.21875 0.159229 0.0927363 2024-09-16T07:51:25.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 41 16 7082 7066 1.3463 1.41406 0.0614312 0.0927815 2024-09-16T07:51:26.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:26.502+0000 7fac45391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:26.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:26.509+0000 7fac45391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:26.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 42 16 7209 7193 1.33787 0.992188 0.118185 0.0932624 2024-09-16T07:51:27.883 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:51:27.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:51:27.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 43 16 7365 7349 1.33509 1.21875 0.165963 0.0934716 2024-09-16T07:51:28.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:28.044+0000 7fc0b4508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:28.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:28.058+0000 7fc0b4508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:28.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 44 16 7524 7508 1.33298 1.24219 0.135737 0.0936438 2024-09-16T07:51:29.037 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:29.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:29.162+0000 7fa942311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:29.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:29.169+0000 7fa942311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:29.311 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:51:29.333 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:51:29.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:29.461+0000 7f4519391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:29.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:29.478+0000 7f4519391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:29.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 45 16 7669 7653 1.32853 1.13281 0.113671 0.0939612 2024-09-16T07:51:30.312 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:51:30.337 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:51:30.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:30.483+0000 7fa496088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:30.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:30.497+0000 7fa496088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:30.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 46 16 7852 7836 1.33073 1.42969 0.0734207 0.093837 2024-09-16T07:51:31.318 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:51:31.343 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:51:31.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:31.483+0000 7f34a9e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:31.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:31.496+0000 7f34a9e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:31.557 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:31.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:31.713+0000 7f0e0707d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:31.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:31.719+0000 7f0e0707d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:31.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 47 16 8020 8004 1.33034 1.3125 0.0697809 0.0938557 2024-09-16T07:51:32.298 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:51:32.319 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:51:32.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:32.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:32.458+0000 7f03b8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:32.467+0000 7f03b8591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.682 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:51:32.682 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:51:32.700 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-09-16T07:51:32.300636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43393587,"num_objects":658,"num_object_clones":0,"num_object_copies":1974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5306,"num_write_kb":42908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":559128,"kb_used_data":63128,"kb_used_omap":0,"kb_used_meta":495936,"kb_avail":376928232,"statfs":{"total":386547056640,"available":385974509568,"internally_reserved":0,"allocated":64643072,"data_stored":126995937,"data_compressed":6510459,"data_compressed_allocated":62324736,"data_compressed_original":126124032,"omap_allocated":0,"internal_metadata":507838464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.466904"},"pg_stats":[{"pgid":"9.7","version":"65'313","reported_seq":337,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.431346+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:51:14.431346+0000","last_peered":"2024-09-16T07:51:14.431346+0000","last_clean":"2024-09-16T07:51:14.431346+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:51:14.431346+0000","last_undegraded":"2024-09-16T07:51:14.431346+0000","last_fullsized":"2024-09-16T07:51:14.431346+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2564096,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"65'288","reported_seq":312,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.681941+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:51:13.681941+0000","last_peered":"2024-09-16T07:51:13.681941+0000","last_clean":"2024-09-16T07:51:13.681941+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:51:13.681941+0000","last_undegraded":"2024-09-16T07:51:13.681941+0000","last_fullsized":"2024-09-16T07:51:13.681941+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"65'288","reported_seq":312,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.278245+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:51:14.278245+0000","last_peered":"2024-09-16T07:51:14.278245+0000","last_clean":"2024-09-16T07:51:14.278245+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:51:14.278245+0000","last_undegraded":"2024-09-16T07:51:14.278245+0000","last_fullsized":"2024-09-16T07:51:14.278245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"65'280","reported_seq":304,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.476313+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:51:13.476313+0000","last_peered":"2024-09-16T07:51:13.476313+0000","last_clean":"2024-09-16T07:51:13.476313+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:51:13.476313+0000","last_undegraded":"2024-09-16T07:51:13.476313+0000","last_fullsized":"2024-09-16T07:51:13.476313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"65'280","reported_seq":304,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.201865+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:51:14.201865+0000","last_peered":"2024-09-16T07:51:14.201865+0000","last_clean":"2024-09-16T07:51:14.201865+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:51:14.201865+0000","last_undegraded":"2024-09-16T07:51:14.201865+0000","last_fullsized":"2024-09-16T07:51:14.201865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"65'352","reported_seq":376,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.449106+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:51:13.449106+0000","last_peered":"2024-09-16T07:51:13.449106+0000","last_clean":"2024-09-16T07:51:13.449106+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:51:13.449106+0000","last_undegraded":"2024-09-16T07:51:13.449106+0000","last_fullsized":"2024-09-16T07:51:13.449106+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"65'384","reported_seq":408,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.047743+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:51:14.047743+0000","last_peered":"2024-09-16T07:51:14.047743+0000","last_clean":"2024-09-16T07:51:14.047743+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:51:14.047743+0000","last_undegraded":"2024-09-16T07:51:14.047743+0000","last_fullsized":"2024-09-16T07:51:14.047743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"65'312","reported_seq":336,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.339231+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:51:14.339231+0000","last_peered":"2024-09-16T07:51:14.339231+0000","last_clean":"2024-09-16T07:51:14.339231+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:51:14.339231+0000","last_undegraded":"2024-09-16T07:51:14.339231+0000","last_fullsized":"2024-09-16T07:51:14.339231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"65'296","reported_seq":320,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.173504+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:51:14.173504+0000","last_peered":"2024-09-16T07:51:14.173504+0000","last_clean":"2024-09-16T07:51:14.173504+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:51:14.173504+0000","last_undegraded":"2024-09-16T07:51:14.173504+0000","last_fullsized":"2024-09-16T07:51:14.173504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.403293+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:09.403293+0000","last_peered":"2024-09-16T07:51:09.403293+0000","last_clean":"2024-09-16T07:51:09.403293+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:09.403293+0000","last_undegraded":"2024-09-16T07:51:09.403293+0000","last_fullsized":"2024-09-16T07:51:09.403293+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":170,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.365988+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:09.365988+0000","last_peered":"2024-09-16T07:51:09.365988+0000","last_clean":"2024-09-16T07:51:09.365988+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:09.365988+0000","last_undegraded":"2024-09-16T07:51:09.365988+0000","last_fullsized":"2024-09-16T07:51:09.365988+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"65'312","reported_seq":336,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.752275+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:51:14.752275+0000","last_peered":"2024-09-16T07:51:14.752275+0000","last_clean":"2024-09-16T07:51:14.752275+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:51:14.752275+0000","last_undegraded":"2024-09-16T07:51:14.752275+0000","last_fullsized":"2024-09-16T07:51:14.752275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.357867+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:09.357867+0000","last_peered":"2024-09-16T07:51:09.357867+0000","last_clean":"2024-09-16T07:51:09.357867+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:09.357867+0000","last_undegraded":"2024-09-16T07:51:09.357867+0000","last_fullsized":"2024-09-16T07:51:09.357867+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"65'360","reported_seq":384,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.614377+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:51:14.614377+0000","last_peered":"2024-09-16T07:51:14.614377+0000","last_clean":"2024-09-16T07:51:14.614377+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:51:14.614377+0000","last_undegraded":"2024-09-16T07:51:14.614377+0000","last_fullsized":"2024-09-16T07:51:14.614377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.367922+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:09.367922+0000","last_peered":"2024-09-16T07:51:09.367922+0000","last_clean":"2024-09-16T07:51:09.367922+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:09.367922+0000","last_undegraded":"2024-09-16T07:51:09.367922+0000","last_fullsized":"2024-09-16T07:51:09.367922+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"65'360","reported_seq":384,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.641506+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:51:14.641506+0000","last_peered":"2024-09-16T07:51:14.641506+0000","last_clean":"2024-09-16T07:51:14.641506+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:51:14.641506+0000","last_undegraded":"2024-09-16T07:51:14.641506+0000","last_fullsized":"2024-09-16T07:51:14.641506+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":171,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.365301+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:09.365301+0000","last_peered":"2024-09-16T07:51:09.365301+0000","last_clean":"2024-09-16T07:51:09.365301+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:09.365301+0000","last_undegraded":"2024-09-16T07:51:09.365301+0000","last_fullsized":"2024-09-16T07:51:09.365301+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"65'224","reported_seq":248,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:11.747103+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:51:11.747103+0000","last_peered":"2024-09-16T07:51:11.747103+0000","last_clean":"2024-09-16T07:51:11.747103+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:51:11.747103+0000","last_undegraded":"2024-09-16T07:51:11.747103+0000","last_fullsized":"2024-09-16T07:51:11.747103+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.398653+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:09.398653+0000","last_peered":"2024-09-16T07:51:09.398653+0000","last_clean":"2024-09-16T07:51:09.398653+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:09.398653+0000","last_undegraded":"2024-09-16T07:51:09.398653+0000","last_fullsized":"2024-09-16T07:51:09.398653+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"65'392","reported_seq":416,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.688623+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:51:14.688623+0000","last_peered":"2024-09-16T07:51:14.688623+0000","last_clean":"2024-09-16T07:51:14.688623+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:51:14.688623+0000","last_undegraded":"2024-09-16T07:51:14.688623+0000","last_fullsized":"2024-09-16T07:51:14.688623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.400401+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:09.400401+0000","last_peered":"2024-09-16T07:51:09.400401+0000","last_clean":"2024-09-16T07:51:09.400401+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:09.400401+0000","last_undegraded":"2024-09-16T07:51:09.400401+0000","last_fullsized":"2024-09-16T07:51:09.400401+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"65'352","reported_seq":376,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.764779+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:51:14.764779+0000","last_peered":"2024-09-16T07:51:14.764779+0000","last_clean":"2024-09-16T07:51:14.764779+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:51:14.764779+0000","last_undegraded":"2024-09-16T07:51:14.764779+0000","last_fullsized":"2024-09-16T07:51:14.764779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.405668+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:09.405668+0000","last_peered":"2024-09-16T07:51:09.405668+0000","last_clean":"2024-09-16T07:51:09.405668+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:09.405668+0000","last_undegraded":"2024-09-16T07:51:09.405668+0000","last_fullsized":"2024-09-16T07:51:09.405668+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"65'432","reported_seq":456,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.597101+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:51:13.597101+0000","last_peered":"2024-09-16T07:51:13.597101+0000","last_clean":"2024-09-16T07:51:13.597101+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:51:13.597101+0000","last_undegraded":"2024-09-16T07:51:13.597101+0000","last_fullsized":"2024-09-16T07:51:13.597101+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.361801+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:09.361801+0000","last_peered":"2024-09-16T07:51:09.361801+0000","last_clean":"2024-09-16T07:51:09.361801+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:09.361801+0000","last_undegraded":"2024-09-16T07:51:09.361801+0000","last_fullsized":"2024-09-16T07:51:09.361801+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":42803200,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5225,"num_write_kb":41800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64151552,"data_stored":128303104,"data_compressed":6621696,"data_compressed_allocated":64151552,"data_compressed_original":128303104,"omap_allocated":0,"internal_metadata":0},"log_size":5225,"ondisk_log_size":5225,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137676,"kb_used_data":12284,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94234164,"statfs":{"total":96636764160,"available":96495783936,"internally_reserved":0,"allocated":12578816,"data_stored":24232421,"data_compressed":1239985,"data_compressed_allocated":12013568,"data_compressed_original":24027136,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149428,"kb_used_data":19876,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94222412,"statfs":{"total":96636764160,"available":96483749888,"internally_reserved":0,"allocated":20353024,"data_stored":40248325,"data_compressed":2066151,"data_compressed_allocated":19767296,"data_compressed_original":40026112,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125704,"kb_used_data":14200,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94246136,"statfs":{"total":96636764160,"available":96508043264,"internally_reserved":0,"allocated":14540800,"data_stored":28623877,"data_compressed":1466226,"data_compressed_allocated":13955072,"data_compressed_original":28401664,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":146320,"kb_used_data":16768,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94225520,"statfs":{"total":96636764160,"available":96486932480,"internally_reserved":0,"allocated":17170432,"data_stored":33891314,"data_compressed":1738097,"data_compressed_allocated":16588800,"data_compressed_original":33669120,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17186816,"data_stored":34373632,"data_compressed":1774048,"data_compressed_allocated":17186816,"data_compressed_original":34373632,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14372864,"data_stored":28745728,"data_compressed":1483565,"data_compressed_allocated":14372864,"data_compressed_original":28745728,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20176896,"data_stored":40353792,"data_compressed":2082644,"data_compressed_allocated":20176896,"data_compressed_original":40353792,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12414976,"data_stored":24829952,"data_compressed":1281439,"data_compressed_allocated":12414976,"data_compressed_original":24829952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:32.701 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:32.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:32.830+0000 7f1637d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:32.839+0000 7f1637d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:32.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 48 16 8163 8147 1.32589 1.11719 0.0950483 0.0941443 2024-09-16T07:51:33.099 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:51:33.100 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:51:33.118 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-09-16T07:51:32.300636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43393587,"num_objects":658,"num_object_clones":0,"num_object_copies":1974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5306,"num_write_kb":42908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":559128,"kb_used_data":63128,"kb_used_omap":0,"kb_used_meta":495936,"kb_avail":376928232,"statfs":{"total":386547056640,"available":385974509568,"internally_reserved":0,"allocated":64643072,"data_stored":126995937,"data_compressed":6510459,"data_compressed_allocated":62324736,"data_compressed_original":126124032,"omap_allocated":0,"internal_metadata":507838464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.466904"},"pg_stats":[{"pgid":"9.7","version":"65'313","reported_seq":337,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.431346+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:51:14.431346+0000","last_peered":"2024-09-16T07:51:14.431346+0000","last_clean":"2024-09-16T07:51:14.431346+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:51:14.431346+0000","last_undegraded":"2024-09-16T07:51:14.431346+0000","last_fullsized":"2024-09-16T07:51:14.431346+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2564096,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"65'288","reported_seq":312,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.681941+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:51:13.681941+0000","last_peered":"2024-09-16T07:51:13.681941+0000","last_clean":"2024-09-16T07:51:13.681941+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:51:13.681941+0000","last_undegraded":"2024-09-16T07:51:13.681941+0000","last_fullsized":"2024-09-16T07:51:13.681941+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"65'288","reported_seq":312,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.278245+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:51:14.278245+0000","last_peered":"2024-09-16T07:51:14.278245+0000","last_clean":"2024-09-16T07:51:14.278245+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:51:14.278245+0000","last_undegraded":"2024-09-16T07:51:14.278245+0000","last_fullsized":"2024-09-16T07:51:14.278245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"65'280","reported_seq":304,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.476313+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:51:13.476313+0000","last_peered":"2024-09-16T07:51:13.476313+0000","last_clean":"2024-09-16T07:51:13.476313+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:51:13.476313+0000","last_undegraded":"2024-09-16T07:51:13.476313+0000","last_fullsized":"2024-09-16T07:51:13.476313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"65'280","reported_seq":304,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.201865+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:51:14.201865+0000","last_peered":"2024-09-16T07:51:14.201865+0000","last_clean":"2024-09-16T07:51:14.201865+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:51:14.201865+0000","last_undegraded":"2024-09-16T07:51:14.201865+0000","last_fullsized":"2024-09-16T07:51:14.201865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"65'352","reported_seq":376,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.449106+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:51:13.449106+0000","last_peered":"2024-09-16T07:51:13.449106+0000","last_clean":"2024-09-16T07:51:13.449106+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:51:13.449106+0000","last_undegraded":"2024-09-16T07:51:13.449106+0000","last_fullsized":"2024-09-16T07:51:13.449106+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"65'384","reported_seq":408,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.047743+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:51:14.047743+0000","last_peered":"2024-09-16T07:51:14.047743+0000","last_clean":"2024-09-16T07:51:14.047743+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:51:14.047743+0000","last_undegraded":"2024-09-16T07:51:14.047743+0000","last_fullsized":"2024-09-16T07:51:14.047743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"65'312","reported_seq":336,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.339231+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:51:14.339231+0000","last_peered":"2024-09-16T07:51:14.339231+0000","last_clean":"2024-09-16T07:51:14.339231+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:51:14.339231+0000","last_undegraded":"2024-09-16T07:51:14.339231+0000","last_fullsized":"2024-09-16T07:51:14.339231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"65'296","reported_seq":320,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.173504+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:51:14.173504+0000","last_peered":"2024-09-16T07:51:14.173504+0000","last_clean":"2024-09-16T07:51:14.173504+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:51:14.173504+0000","last_undegraded":"2024-09-16T07:51:14.173504+0000","last_fullsized":"2024-09-16T07:51:14.173504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.403293+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:09.403293+0000","last_peered":"2024-09-16T07:51:09.403293+0000","last_clean":"2024-09-16T07:51:09.403293+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:09.403293+0000","last_undegraded":"2024-09-16T07:51:09.403293+0000","last_fullsized":"2024-09-16T07:51:09.403293+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":170,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.365988+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:09.365988+0000","last_peered":"2024-09-16T07:51:09.365988+0000","last_clean":"2024-09-16T07:51:09.365988+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:09.365988+0000","last_undegraded":"2024-09-16T07:51:09.365988+0000","last_fullsized":"2024-09-16T07:51:09.365988+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"65'312","reported_seq":336,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.752275+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:51:14.752275+0000","last_peered":"2024-09-16T07:51:14.752275+0000","last_clean":"2024-09-16T07:51:14.752275+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:51:14.752275+0000","last_undegraded":"2024-09-16T07:51:14.752275+0000","last_fullsized":"2024-09-16T07:51:14.752275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.357867+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:09.357867+0000","last_peered":"2024-09-16T07:51:09.357867+0000","last_clean":"2024-09-16T07:51:09.357867+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:09.357867+0000","last_undegraded":"2024-09-16T07:51:09.357867+0000","last_fullsized":"2024-09-16T07:51:09.357867+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"65'360","reported_seq":384,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.614377+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:51:14.614377+0000","last_peered":"2024-09-16T07:51:14.614377+0000","last_clean":"2024-09-16T07:51:14.614377+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:51:14.614377+0000","last_undegraded":"2024-09-16T07:51:14.614377+0000","last_fullsized":"2024-09-16T07:51:14.614377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.367922+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:09.367922+0000","last_peered":"2024-09-16T07:51:09.367922+0000","last_clean":"2024-09-16T07:51:09.367922+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:09.367922+0000","last_undegraded":"2024-09-16T07:51:09.367922+0000","last_fullsized":"2024-09-16T07:51:09.367922+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"65'360","reported_seq":384,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.641506+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:51:14.641506+0000","last_peered":"2024-09-16T07:51:14.641506+0000","last_clean":"2024-09-16T07:51:14.641506+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:51:14.641506+0000","last_undegraded":"2024-09-16T07:51:14.641506+0000","last_fullsized":"2024-09-16T07:51:14.641506+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":171,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.365301+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:09.365301+0000","last_peered":"2024-09-16T07:51:09.365301+0000","last_clean":"2024-09-16T07:51:09.365301+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:09.365301+0000","last_undegraded":"2024-09-16T07:51:09.365301+0000","last_fullsized":"2024-09-16T07:51:09.365301+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"65'224","reported_seq":248,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:11.747103+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:51:11.747103+0000","last_peered":"2024-09-16T07:51:11.747103+0000","last_clean":"2024-09-16T07:51:11.747103+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:51:11.747103+0000","last_undegraded":"2024-09-16T07:51:11.747103+0000","last_fullsized":"2024-09-16T07:51:11.747103+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.398653+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:09.398653+0000","last_peered":"2024-09-16T07:51:09.398653+0000","last_clean":"2024-09-16T07:51:09.398653+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:09.398653+0000","last_undegraded":"2024-09-16T07:51:09.398653+0000","last_fullsized":"2024-09-16T07:51:09.398653+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"65'392","reported_seq":416,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.688623+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:51:14.688623+0000","last_peered":"2024-09-16T07:51:14.688623+0000","last_clean":"2024-09-16T07:51:14.688623+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:51:14.688623+0000","last_undegraded":"2024-09-16T07:51:14.688623+0000","last_fullsized":"2024-09-16T07:51:14.688623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.400401+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:09.400401+0000","last_peered":"2024-09-16T07:51:09.400401+0000","last_clean":"2024-09-16T07:51:09.400401+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:09.400401+0000","last_undegraded":"2024-09-16T07:51:09.400401+0000","last_fullsized":"2024-09-16T07:51:09.400401+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"65'352","reported_seq":376,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.764779+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:51:14.764779+0000","last_peered":"2024-09-16T07:51:14.764779+0000","last_clean":"2024-09-16T07:51:14.764779+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:51:14.764779+0000","last_undegraded":"2024-09-16T07:51:14.764779+0000","last_fullsized":"2024-09-16T07:51:14.764779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.405668+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:09.405668+0000","last_peered":"2024-09-16T07:51:09.405668+0000","last_clean":"2024-09-16T07:51:09.405668+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:09.405668+0000","last_undegraded":"2024-09-16T07:51:09.405668+0000","last_fullsized":"2024-09-16T07:51:09.405668+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"65'432","reported_seq":456,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.597101+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:51:13.597101+0000","last_peered":"2024-09-16T07:51:13.597101+0000","last_clean":"2024-09-16T07:51:13.597101+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:51:13.597101+0000","last_undegraded":"2024-09-16T07:51:13.597101+0000","last_fullsized":"2024-09-16T07:51:13.597101+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.361801+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:09.361801+0000","last_peered":"2024-09-16T07:51:09.361801+0000","last_clean":"2024-09-16T07:51:09.361801+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:09.361801+0000","last_undegraded":"2024-09-16T07:51:09.361801+0000","last_fullsized":"2024-09-16T07:51:09.361801+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":42803200,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5225,"num_write_kb":41800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64151552,"data_stored":128303104,"data_compressed":6621696,"data_compressed_allocated":64151552,"data_compressed_original":128303104,"omap_allocated":0,"internal_metadata":0},"log_size":5225,"ondisk_log_size":5225,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137676,"kb_used_data":12284,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94234164,"statfs":{"total":96636764160,"available":96495783936,"internally_reserved":0,"allocated":12578816,"data_stored":24232421,"data_compressed":1239985,"data_compressed_allocated":12013568,"data_compressed_original":24027136,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149428,"kb_used_data":19876,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94222412,"statfs":{"total":96636764160,"available":96483749888,"internally_reserved":0,"allocated":20353024,"data_stored":40248325,"data_compressed":2066151,"data_compressed_allocated":19767296,"data_compressed_original":40026112,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125704,"kb_used_data":14200,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94246136,"statfs":{"total":96636764160,"available":96508043264,"internally_reserved":0,"allocated":14540800,"data_stored":28623877,"data_compressed":1466226,"data_compressed_allocated":13955072,"data_compressed_original":28401664,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":146320,"kb_used_data":16768,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94225520,"statfs":{"total":96636764160,"available":96486932480,"internally_reserved":0,"allocated":17170432,"data_stored":33891314,"data_compressed":1738097,"data_compressed_allocated":16588800,"data_compressed_original":33669120,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17186816,"data_stored":34373632,"data_compressed":1774048,"data_compressed_allocated":17186816,"data_compressed_original":34373632,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14372864,"data_stored":28745728,"data_compressed":1483565,"data_compressed_allocated":14372864,"data_compressed_original":28745728,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20176896,"data_stored":40353792,"data_compressed":2082644,"data_compressed_allocated":20176896,"data_compressed_original":40353792,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12414976,"data_stored":24829952,"data_compressed":1281439,"data_compressed_allocated":12414976,"data_compressed_original":24829952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:33.120 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:51:33.120 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:51:33.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:33.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:33.258+0000 7f1e4f623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:33.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:33.270+0000 7f1e4f623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:33.501 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:51:33.502 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:51:33.523 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-09-16T07:51:32.300636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43393587,"num_objects":658,"num_object_clones":0,"num_object_copies":1974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5306,"num_write_kb":42908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":559128,"kb_used_data":63128,"kb_used_omap":0,"kb_used_meta":495936,"kb_avail":376928232,"statfs":{"total":386547056640,"available":385974509568,"internally_reserved":0,"allocated":64643072,"data_stored":126995937,"data_compressed":6510459,"data_compressed_allocated":62324736,"data_compressed_original":126124032,"omap_allocated":0,"internal_metadata":507838464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.466904"},"pg_stats":[{"pgid":"9.7","version":"65'313","reported_seq":337,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.431346+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:51:14.431346+0000","last_peered":"2024-09-16T07:51:14.431346+0000","last_clean":"2024-09-16T07:51:14.431346+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:51:14.431346+0000","last_undegraded":"2024-09-16T07:51:14.431346+0000","last_fullsized":"2024-09-16T07:51:14.431346+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2564096,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"65'288","reported_seq":312,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.681941+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:51:13.681941+0000","last_peered":"2024-09-16T07:51:13.681941+0000","last_clean":"2024-09-16T07:51:13.681941+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:51:13.681941+0000","last_undegraded":"2024-09-16T07:51:13.681941+0000","last_fullsized":"2024-09-16T07:51:13.681941+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"65'288","reported_seq":312,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.278245+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:51:14.278245+0000","last_peered":"2024-09-16T07:51:14.278245+0000","last_clean":"2024-09-16T07:51:14.278245+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:51:14.278245+0000","last_undegraded":"2024-09-16T07:51:14.278245+0000","last_fullsized":"2024-09-16T07:51:14.278245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"65'280","reported_seq":304,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.476313+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:51:13.476313+0000","last_peered":"2024-09-16T07:51:13.476313+0000","last_clean":"2024-09-16T07:51:13.476313+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:51:13.476313+0000","last_undegraded":"2024-09-16T07:51:13.476313+0000","last_fullsized":"2024-09-16T07:51:13.476313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"65'280","reported_seq":304,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.201865+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:51:14.201865+0000","last_peered":"2024-09-16T07:51:14.201865+0000","last_clean":"2024-09-16T07:51:14.201865+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:51:14.201865+0000","last_undegraded":"2024-09-16T07:51:14.201865+0000","last_fullsized":"2024-09-16T07:51:14.201865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"65'352","reported_seq":376,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.449106+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:51:13.449106+0000","last_peered":"2024-09-16T07:51:13.449106+0000","last_clean":"2024-09-16T07:51:13.449106+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:51:13.449106+0000","last_undegraded":"2024-09-16T07:51:13.449106+0000","last_fullsized":"2024-09-16T07:51:13.449106+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"65'384","reported_seq":408,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.047743+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:51:14.047743+0000","last_peered":"2024-09-16T07:51:14.047743+0000","last_clean":"2024-09-16T07:51:14.047743+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:51:14.047743+0000","last_undegraded":"2024-09-16T07:51:14.047743+0000","last_fullsized":"2024-09-16T07:51:14.047743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"65'312","reported_seq":336,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.339231+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:51:14.339231+0000","last_peered":"2024-09-16T07:51:14.339231+0000","last_clean":"2024-09-16T07:51:14.339231+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:51:14.339231+0000","last_undegraded":"2024-09-16T07:51:14.339231+0000","last_fullsized":"2024-09-16T07:51:14.339231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"65'296","reported_seq":320,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.173504+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:51:14.173504+0000","last_peered":"2024-09-16T07:51:14.173504+0000","last_clean":"2024-09-16T07:51:14.173504+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:51:14.173504+0000","last_undegraded":"2024-09-16T07:51:14.173504+0000","last_fullsized":"2024-09-16T07:51:14.173504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.403293+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:09.403293+0000","last_peered":"2024-09-16T07:51:09.403293+0000","last_clean":"2024-09-16T07:51:09.403293+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:09.403293+0000","last_undegraded":"2024-09-16T07:51:09.403293+0000","last_fullsized":"2024-09-16T07:51:09.403293+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":170,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.365988+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:09.365988+0000","last_peered":"2024-09-16T07:51:09.365988+0000","last_clean":"2024-09-16T07:51:09.365988+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:09.365988+0000","last_undegraded":"2024-09-16T07:51:09.365988+0000","last_fullsized":"2024-09-16T07:51:09.365988+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"65'312","reported_seq":336,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.752275+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:51:14.752275+0000","last_peered":"2024-09-16T07:51:14.752275+0000","last_clean":"2024-09-16T07:51:14.752275+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:51:14.752275+0000","last_undegraded":"2024-09-16T07:51:14.752275+0000","last_fullsized":"2024-09-16T07:51:14.752275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.357867+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:09.357867+0000","last_peered":"2024-09-16T07:51:09.357867+0000","last_clean":"2024-09-16T07:51:09.357867+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:09.357867+0000","last_undegraded":"2024-09-16T07:51:09.357867+0000","last_fullsized":"2024-09-16T07:51:09.357867+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"65'360","reported_seq":384,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.614377+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:51:14.614377+0000","last_peered":"2024-09-16T07:51:14.614377+0000","last_clean":"2024-09-16T07:51:14.614377+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:51:14.614377+0000","last_undegraded":"2024-09-16T07:51:14.614377+0000","last_fullsized":"2024-09-16T07:51:14.614377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.367922+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:09.367922+0000","last_peered":"2024-09-16T07:51:09.367922+0000","last_clean":"2024-09-16T07:51:09.367922+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:09.367922+0000","last_undegraded":"2024-09-16T07:51:09.367922+0000","last_fullsized":"2024-09-16T07:51:09.367922+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"65'360","reported_seq":384,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.641506+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:51:14.641506+0000","last_peered":"2024-09-16T07:51:14.641506+0000","last_clean":"2024-09-16T07:51:14.641506+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:51:14.641506+0000","last_undegraded":"2024-09-16T07:51:14.641506+0000","last_fullsized":"2024-09-16T07:51:14.641506+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":171,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.365301+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:09.365301+0000","last_peered":"2024-09-16T07:51:09.365301+0000","last_clean":"2024-09-16T07:51:09.365301+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:09.365301+0000","last_undegraded":"2024-09-16T07:51:09.365301+0000","last_fullsized":"2024-09-16T07:51:09.365301+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"65'224","reported_seq":248,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:11.747103+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:51:11.747103+0000","last_peered":"2024-09-16T07:51:11.747103+0000","last_clean":"2024-09-16T07:51:11.747103+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:51:11.747103+0000","last_undegraded":"2024-09-16T07:51:11.747103+0000","last_fullsized":"2024-09-16T07:51:11.747103+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.398653+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:09.398653+0000","last_peered":"2024-09-16T07:51:09.398653+0000","last_clean":"2024-09-16T07:51:09.398653+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:09.398653+0000","last_undegraded":"2024-09-16T07:51:09.398653+0000","last_fullsized":"2024-09-16T07:51:09.398653+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"65'392","reported_seq":416,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.688623+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:51:14.688623+0000","last_peered":"2024-09-16T07:51:14.688623+0000","last_clean":"2024-09-16T07:51:14.688623+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:51:14.688623+0000","last_undegraded":"2024-09-16T07:51:14.688623+0000","last_fullsized":"2024-09-16T07:51:14.688623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.400401+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:09.400401+0000","last_peered":"2024-09-16T07:51:09.400401+0000","last_clean":"2024-09-16T07:51:09.400401+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:09.400401+0000","last_undegraded":"2024-09-16T07:51:09.400401+0000","last_fullsized":"2024-09-16T07:51:09.400401+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"65'352","reported_seq":376,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.764779+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:51:14.764779+0000","last_peered":"2024-09-16T07:51:14.764779+0000","last_clean":"2024-09-16T07:51:14.764779+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:51:14.764779+0000","last_undegraded":"2024-09-16T07:51:14.764779+0000","last_fullsized":"2024-09-16T07:51:14.764779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.405668+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:09.405668+0000","last_peered":"2024-09-16T07:51:09.405668+0000","last_clean":"2024-09-16T07:51:09.405668+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:09.405668+0000","last_undegraded":"2024-09-16T07:51:09.405668+0000","last_fullsized":"2024-09-16T07:51:09.405668+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"65'432","reported_seq":456,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.597101+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:51:13.597101+0000","last_peered":"2024-09-16T07:51:13.597101+0000","last_clean":"2024-09-16T07:51:13.597101+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:51:13.597101+0000","last_undegraded":"2024-09-16T07:51:13.597101+0000","last_fullsized":"2024-09-16T07:51:13.597101+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.361801+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:09.361801+0000","last_peered":"2024-09-16T07:51:09.361801+0000","last_clean":"2024-09-16T07:51:09.361801+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:09.361801+0000","last_undegraded":"2024-09-16T07:51:09.361801+0000","last_fullsized":"2024-09-16T07:51:09.361801+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":42803200,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5225,"num_write_kb":41800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64151552,"data_stored":128303104,"data_compressed":6621696,"data_compressed_allocated":64151552,"data_compressed_original":128303104,"omap_allocated":0,"internal_metadata":0},"log_size":5225,"ondisk_log_size":5225,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137676,"kb_used_data":12284,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94234164,"statfs":{"total":96636764160,"available":96495783936,"internally_reserved":0,"allocated":12578816,"data_stored":24232421,"data_compressed":1239985,"data_compressed_allocated":12013568,"data_compressed_original":24027136,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149428,"kb_used_data":19876,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94222412,"statfs":{"total":96636764160,"available":96483749888,"internally_reserved":0,"allocated":20353024,"data_stored":40248325,"data_compressed":2066151,"data_compressed_allocated":19767296,"data_compressed_original":40026112,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125704,"kb_used_data":14200,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94246136,"statfs":{"total":96636764160,"available":96508043264,"internally_reserved":0,"allocated":14540800,"data_stored":28623877,"data_compressed":1466226,"data_compressed_allocated":13955072,"data_compressed_original":28401664,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":146320,"kb_used_data":16768,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94225520,"statfs":{"total":96636764160,"available":96486932480,"internally_reserved":0,"allocated":17170432,"data_stored":33891314,"data_compressed":1738097,"data_compressed_allocated":16588800,"data_compressed_original":33669120,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17186816,"data_stored":34373632,"data_compressed":1774048,"data_compressed_allocated":17186816,"data_compressed_original":34373632,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14372864,"data_stored":28745728,"data_compressed":1483565,"data_compressed_allocated":14372864,"data_compressed_original":28745728,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20176896,"data_stored":40353792,"data_compressed":2082644,"data_compressed_allocated":20176896,"data_compressed_original":40353792,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12414976,"data_stored":24829952,"data_compressed":1281439,"data_compressed_allocated":12414976,"data_compressed_original":24829952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:33.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 49 16 8328 8312 1.32514 1.28906 0.0963041 0.0941699 2024-09-16T07:51:34.178 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:34.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:34.335+0000 7f8edec9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:34.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:34.346+0000 7f8edec9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:34.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 50 16 8478 8462 1.32207 1.17188 0.0432051 0.0943719 2024-09-16T07:51:35.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 51 16 8616 8600 1.31729 1.07812 0.0468939 0.0947966 2024-09-16T07:51:36.687 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:36.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:36.820+0000 7ff105f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:36.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:36.829+0000 7ff105f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:36.990 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 52 16 8782 8766 1.31689 1.29688 0.136966 0.0948021 2024-09-16T07:51:37.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 53 16 8933 8917 1.3143 1.17969 0.0902939 0.0949797 2024-09-16T07:51:38.526 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:51:38.526 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:51:38.526 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:38.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:38.670+0000 7fbad9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:38.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:38.683+0000 7fbad9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:38.970 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:51:38.970 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:51:38.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 54 16 9110 9094 1.31557 1.38281 0.0746138 0.0948814 2024-09-16T07:51:38.992 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2024-09-16T07:51:37.835749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":43393587,"num_objects":658,"num_object_clones":0,"num_object_copies":1974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":5306,"num_write_kb":42908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5280,"ondisk_log_size":5280,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":559128,"kb_used_data":63128,"kb_used_omap":0,"kb_used_meta":495936,"kb_avail":376928232,"statfs":{"total":386547056640,"available":385974509568,"internally_reserved":0,"allocated":64643072,"data_stored":126995937,"data_compressed":6510459,"data_compressed_allocated":62324736,"data_compressed_original":126124032,"omap_allocated":0,"internal_metadata":507838464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.512654"},"pg_stats":[{"pgid":"9.7","version":"65'313","reported_seq":337,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.431346+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:51:14.431346+0000","last_peered":"2024-09-16T07:51:14.431346+0000","last_clean":"2024-09-16T07:51:14.431346+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:51:14.431346+0000","last_undegraded":"2024-09-16T07:51:14.431346+0000","last_fullsized":"2024-09-16T07:51:14.431346+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2564096,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":313,"num_write_kb":2504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"65'288","reported_seq":312,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.681941+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:51:13.681941+0000","last_peered":"2024-09-16T07:51:13.681941+0000","last_clean":"2024-09-16T07:51:13.681941+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:51:13.681941+0000","last_undegraded":"2024-09-16T07:51:13.681941+0000","last_fullsized":"2024-09-16T07:51:13.681941+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"65'288","reported_seq":312,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.278245+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:51:14.278245+0000","last_peered":"2024-09-16T07:51:14.278245+0000","last_clean":"2024-09-16T07:51:14.278245+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:51:14.278245+0000","last_undegraded":"2024-09-16T07:51:14.278245+0000","last_fullsized":"2024-09-16T07:51:14.278245+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"65'280","reported_seq":304,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.476313+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:51:13.476313+0000","last_peered":"2024-09-16T07:51:13.476313+0000","last_clean":"2024-09-16T07:51:13.476313+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:51:13.476313+0000","last_undegraded":"2024-09-16T07:51:13.476313+0000","last_fullsized":"2024-09-16T07:51:13.476313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"65'280","reported_seq":304,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.201865+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:51:14.201865+0000","last_peered":"2024-09-16T07:51:14.201865+0000","last_clean":"2024-09-16T07:51:14.201865+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:51:14.201865+0000","last_undegraded":"2024-09-16T07:51:14.201865+0000","last_fullsized":"2024-09-16T07:51:14.201865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"65'352","reported_seq":376,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.449106+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:51:13.449106+0000","last_peered":"2024-09-16T07:51:13.449106+0000","last_clean":"2024-09-16T07:51:13.449106+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:51:13.449106+0000","last_undegraded":"2024-09-16T07:51:13.449106+0000","last_fullsized":"2024-09-16T07:51:13.449106+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"65'384","reported_seq":408,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.047743+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:51:14.047743+0000","last_peered":"2024-09-16T07:51:14.047743+0000","last_clean":"2024-09-16T07:51:14.047743+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:51:14.047743+0000","last_undegraded":"2024-09-16T07:51:14.047743+0000","last_fullsized":"2024-09-16T07:51:14.047743+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"65'312","reported_seq":336,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.339231+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:51:14.339231+0000","last_peered":"2024-09-16T07:51:14.339231+0000","last_clean":"2024-09-16T07:51:14.339231+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:51:14.339231+0000","last_undegraded":"2024-09-16T07:51:14.339231+0000","last_fullsized":"2024-09-16T07:51:14.339231+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"65'296","reported_seq":320,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.173504+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:51:14.173504+0000","last_peered":"2024-09-16T07:51:14.173504+0000","last_clean":"2024-09-16T07:51:14.173504+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:51:14.173504+0000","last_undegraded":"2024-09-16T07:51:14.173504+0000","last_fullsized":"2024-09-16T07:51:14.173504+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.403293+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:09.403293+0000","last_peered":"2024-09-16T07:51:09.403293+0000","last_clean":"2024-09-16T07:51:09.403293+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:09.403293+0000","last_undegraded":"2024-09-16T07:51:09.403293+0000","last_fullsized":"2024-09-16T07:51:09.403293+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":170,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.365988+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:09.365988+0000","last_peered":"2024-09-16T07:51:09.365988+0000","last_clean":"2024-09-16T07:51:09.365988+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:09.365988+0000","last_undegraded":"2024-09-16T07:51:09.365988+0000","last_fullsized":"2024-09-16T07:51:09.365988+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"65'312","reported_seq":336,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.752275+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:51:14.752275+0000","last_peered":"2024-09-16T07:51:14.752275+0000","last_clean":"2024-09-16T07:51:14.752275+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:51:14.752275+0000","last_undegraded":"2024-09-16T07:51:14.752275+0000","last_fullsized":"2024-09-16T07:51:14.752275+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2555904,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":2496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.357867+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:09.357867+0000","last_peered":"2024-09-16T07:51:09.357867+0000","last_clean":"2024-09-16T07:51:09.357867+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:09.357867+0000","last_undegraded":"2024-09-16T07:51:09.357867+0000","last_fullsized":"2024-09-16T07:51:09.357867+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"65'360","reported_seq":384,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.614377+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:51:14.614377+0000","last_peered":"2024-09-16T07:51:14.614377+0000","last_clean":"2024-09-16T07:51:14.614377+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:51:14.614377+0000","last_undegraded":"2024-09-16T07:51:14.614377+0000","last_fullsized":"2024-09-16T07:51:14.614377+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.367922+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:09.367922+0000","last_peered":"2024-09-16T07:51:09.367922+0000","last_clean":"2024-09-16T07:51:09.367922+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:09.367922+0000","last_undegraded":"2024-09-16T07:51:09.367922+0000","last_fullsized":"2024-09-16T07:51:09.367922+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"65'360","reported_seq":384,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.641506+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:51:14.641506+0000","last_peered":"2024-09-16T07:51:14.641506+0000","last_clean":"2024-09-16T07:51:14.641506+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:51:14.641506+0000","last_undegraded":"2024-09-16T07:51:14.641506+0000","last_fullsized":"2024-09-16T07:51:14.641506+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":2880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":171,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.365301+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:09.365301+0000","last_peered":"2024-09-16T07:51:09.365301+0000","last_clean":"2024-09-16T07:51:09.365301+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:09.365301+0000","last_undegraded":"2024-09-16T07:51:09.365301+0000","last_fullsized":"2024-09-16T07:51:09.365301+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"65'224","reported_seq":248,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:11.747103+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:51:11.747103+0000","last_peered":"2024-09-16T07:51:11.747103+0000","last_clean":"2024-09-16T07:51:11.747103+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:51:11.747103+0000","last_undegraded":"2024-09-16T07:51:11.747103+0000","last_fullsized":"2024-09-16T07:51:11.747103+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1835008,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.398653+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:09.398653+0000","last_peered":"2024-09-16T07:51:09.398653+0000","last_clean":"2024-09-16T07:51:09.398653+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:09.398653+0000","last_undegraded":"2024-09-16T07:51:09.398653+0000","last_fullsized":"2024-09-16T07:51:09.398653+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"65'392","reported_seq":416,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.688623+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:51:14.688623+0000","last_peered":"2024-09-16T07:51:14.688623+0000","last_clean":"2024-09-16T07:51:14.688623+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:51:14.688623+0000","last_undegraded":"2024-09-16T07:51:14.688623+0000","last_fullsized":"2024-09-16T07:51:14.688623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":392,"num_write_kb":3136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.400401+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:09.400401+0000","last_peered":"2024-09-16T07:51:09.400401+0000","last_clean":"2024-09-16T07:51:09.400401+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:09.400401+0000","last_undegraded":"2024-09-16T07:51:09.400401+0000","last_fullsized":"2024-09-16T07:51:09.400401+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"65'352","reported_seq":376,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:14.764779+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:51:14.764779+0000","last_peered":"2024-09-16T07:51:14.764779+0000","last_clean":"2024-09-16T07:51:14.764779+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:51:14.764779+0000","last_undegraded":"2024-09-16T07:51:14.764779+0000","last_fullsized":"2024-09-16T07:51:14.764779+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.405668+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:09.405668+0000","last_peered":"2024-09-16T07:51:09.405668+0000","last_clean":"2024-09-16T07:51:09.405668+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:09.405668+0000","last_undegraded":"2024-09-16T07:51:09.405668+0000","last_fullsized":"2024-09-16T07:51:09.405668+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"65'432","reported_seq":456,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:13.597101+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:51:13.597101+0000","last_peered":"2024-09-16T07:51:13.597101+0000","last_clean":"2024-09-16T07:51:13.597101+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:51:13.597101+0000","last_undegraded":"2024-09-16T07:51:13.597101+0000","last_fullsized":"2024-09-16T07:51:13.597101+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":432,"num_write_kb":3456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":169,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-16T07:51:09.361801+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:09.361801+0000","last_peered":"2024-09-16T07:51:09.361801+0000","last_clean":"2024-09-16T07:51:09.361801+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:09.361801+0000","last_undegraded":"2024-09-16T07:51:09.361801+0000","last_fullsized":"2024-09-16T07:51:09.361801+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":42803200,"num_objects":654,"num_object_clones":0,"num_object_copies":1962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5225,"num_write_kb":41800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":64151552,"data_stored":128303104,"data_compressed":6621696,"data_compressed_allocated":64151552,"data_compressed_original":128303104,"omap_allocated":0,"internal_metadata":0},"log_size":5225,"ondisk_log_size":5225,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":137676,"kb_used_data":12284,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94234164,"statfs":{"total":96636764160,"available":96495783936,"internally_reserved":0,"allocated":12578816,"data_stored":24232421,"data_compressed":1239985,"data_compressed_allocated":12013568,"data_compressed_original":24027136,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149428,"kb_used_data":19876,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94222412,"statfs":{"total":96636764160,"available":96483749888,"internally_reserved":0,"allocated":20353024,"data_stored":40248325,"data_compressed":2066151,"data_compressed_allocated":19767296,"data_compressed_original":40026112,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125704,"kb_used_data":14200,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94246136,"statfs":{"total":96636764160,"available":96508043264,"internally_reserved":0,"allocated":14540800,"data_stored":28623877,"data_compressed":1466226,"data_compressed_allocated":13955072,"data_compressed_original":28401664,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":146320,"kb_used_data":16768,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94225520,"statfs":{"total":96636764160,"available":96486932480,"internally_reserved":0,"allocated":17170432,"data_stored":33891314,"data_compressed":1738097,"data_compressed_allocated":16588800,"data_compressed_original":33669120,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17186816,"data_stored":34373632,"data_compressed":1774048,"data_compressed_allocated":17186816,"data_compressed_original":34373632,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14372864,"data_stored":28745728,"data_compressed":1483565,"data_compressed_allocated":14372864,"data_compressed_original":28745728,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20176896,"data_stored":40353792,"data_compressed":2082644,"data_compressed_allocated":20176896,"data_compressed_original":40353792,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12414976,"data_stored":24829952,"data_compressed":1281439,"data_compressed_allocated":12414976,"data_compressed_original":24829952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:39.187 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:39.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:39.336+0000 7fe62cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:39.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:39.344+0000 7fe62cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:39.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 55 16 9293 9277 1.31764 1.42969 0.103355 0.0947913 2024-09-16T07:51:40.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 56 16 9472 9456 1.31908 1.39844 0.146891 0.0946599 2024-09-16T07:51:41.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:41.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:41.933+0000 7f1b21791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:41.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:41.940+0000 7f1b21791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:41.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 57 16 9624 9608 1.31677 1.1875 0.058769 0.0947801 2024-09-16T07:51:42.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 58 16 9788 9772 1.31616 1.28125 0.0498465 0.0949005 2024-09-16T07:51:43.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 59 16 9940 9924 1.31397 1.1875 0.0788379 0.0950748 2024-09-16T07:51:43.995 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:51:43.995 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:51:43.995 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:51:43.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:51:44.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.123+0000 7f489b4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.134+0000 7f489b4fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.186 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:44.186 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:44.186 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:44.186 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:44.186 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:44.186 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:44.187 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:44.187 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:44.187 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:44.187 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:44.187 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:44.187 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:44.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:44.190 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:44.190 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:51:44.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:44.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.332+0000 7fbede4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.346+0000 7fbede4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.447+0000 7ffbac0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.456+0000 7ffbac0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.552 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:44.552 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:44.552 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:44.552 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:44.552 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:44.552 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:44.553 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:44.553 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:44.553 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:44.553 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:44.553 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:44.553 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:44.555 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:44.555 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:44.556 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:51:44.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.741+0000 7f3742311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.756+0000 7f3742311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:44.785 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:44.786 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:44.786 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:51:44.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.921+0000 7f01d9cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:44.933+0000 7f01d9cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:44.955 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:44.955 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:44.955 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:44.956 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:44.961 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:44.961 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:44.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:51:44.993244+0000 min lat: 0.0152416 max lat: 0.294102 avg lat: 0.0951881 2024-09-16T07:51:44.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:51:44.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 60 16 10090 10074 1.3116 1.17188 0.0845443 0.0951881 2024-09-16T07:51:45.991 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 61 16 10225 10209 1.30739 1.05469 0.100215 0.0955159 2024-09-16T07:51:46.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:46.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:46.876+0000 7f6791508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:46.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:46.884+0000 7f6791508640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:46.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 62 16 10373 10357 1.30495 1.15625 0.147108 0.095661 2024-09-16T07:51:47.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 63 16 10519 10503 1.30234 1.14062 0.082851 0.0958569 2024-09-16T07:51:48.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 64 16 10677 10661 1.30128 1.23438 0.213267 0.0958891 2024-09-16T07:51:49.284 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:49.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:49.437+0000 7faacaf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:49.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:49.446+0000 7faacaf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:49.964 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:51:49.965 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:51:49.965 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:51:49.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 65 16 10818 10802 1.2982 1.10156 0.14618 0.0961476 2024-09-16T07:51:50.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:50.093+0000 7f6a83991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:50.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:50.104+0000 7f6a83991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:50.425 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:51:50.426 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:51:50.451 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":427,"stamp":"2024-09-16T07:51:49.838375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82887219,"num_objects":1260,"num_object_clones":0,"num_object_copies":3780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10127,"num_write_kb":81476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10101,"ondisk_log_size":10101,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":592728,"kb_used_data":121688,"kb_used_omap":0,"kb_used_meta":470976,"kb_avail":376894632,"statfs":{"total":386547056640,"available":385940103168,"internally_reserved":0,"allocated":124608512,"data_stored":246612089,"data_compressed":12682875,"data_compressed_allocated":122093568,"data_compressed_original":245661696,"omap_allocated":0,"internal_metadata":482279424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39493632,"num_objects":602,"num_object_clones":0,"num_object_copies":1806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4821,"num_write_kb":38568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001753"},"pg_stats":[{"pgid":"9.7","version":"71'648","reported_seq":690,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.351999+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:51:44.351999+0000","last_peered":"2024-09-16T07:51:44.351999+0000","last_clean":"2024-09-16T07:51:44.351999+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:51:44.351999+0000","last_undegraded":"2024-09-16T07:51:44.351999+0000","last_fullsized":"2024-09-16T07:51:44.351999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"71'552","reported_seq":594,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.288452+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:51:44.288452+0000","last_peered":"2024-09-16T07:51:44.288452+0000","last_clean":"2024-09-16T07:51:44.288452+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:51:44.288452+0000","last_undegraded":"2024-09-16T07:51:44.288452+0000","last_fullsized":"2024-09-16T07:51:44.288452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"71'576","reported_seq":618,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.705599+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:51:44.705599+0000","last_peered":"2024-09-16T07:51:44.705599+0000","last_clean":"2024-09-16T07:51:44.705599+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:51:44.705599+0000","last_undegraded":"2024-09-16T07:51:44.705599+0000","last_fullsized":"2024-09-16T07:51:44.705599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"71'616","reported_seq":658,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.703663+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:51:44.703663+0000","last_peered":"2024-09-16T07:51:44.703663+0000","last_clean":"2024-09-16T07:51:44.703663+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:51:44.703663+0000","last_undegraded":"2024-09-16T07:51:44.703663+0000","last_fullsized":"2024-09-16T07:51:44.703663+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"71'592","reported_seq":634,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.632045+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:51:43.632045+0000","last_peered":"2024-09-16T07:51:43.632045+0000","last_clean":"2024-09-16T07:51:43.632045+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:51:43.632045+0000","last_undegraded":"2024-09-16T07:51:43.632045+0000","last_fullsized":"2024-09-16T07:51:43.632045+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"71'672","reported_seq":714,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.552159+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:51:44.552159+0000","last_peered":"2024-09-16T07:51:44.552159+0000","last_clean":"2024-09-16T07:51:44.552159+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:51:44.552159+0000","last_undegraded":"2024-09-16T07:51:44.552159+0000","last_fullsized":"2024-09-16T07:51:44.552159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"71'688","reported_seq":730,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.623397+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:51:44.623397+0000","last_peered":"2024-09-16T07:51:44.623397+0000","last_clean":"2024-09-16T07:51:44.623397+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:51:44.623397+0000","last_undegraded":"2024-09-16T07:51:44.623397+0000","last_fullsized":"2024-09-16T07:51:44.623397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"71'528","reported_seq":570,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.343608+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:51:43.343608+0000","last_peered":"2024-09-16T07:51:43.343608+0000","last_clean":"2024-09-16T07:51:43.343608+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:51:43.343608+0000","last_undegraded":"2024-09-16T07:51:43.343608+0000","last_fullsized":"2024-09-16T07:51:43.343608+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"71'592","reported_seq":634,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.409184+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:51:44.409184+0000","last_peered":"2024-09-16T07:51:44.409184+0000","last_clean":"2024-09-16T07:51:44.409184+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:51:44.409184+0000","last_undegraded":"2024-09-16T07:51:44.409184+0000","last_fullsized":"2024-09-16T07:51:44.409184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":256,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.356497+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:42.356497+0000","last_peered":"2024-09-16T07:51:42.356497+0000","last_clean":"2024-09-16T07:51:42.356497+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:42.356497+0000","last_undegraded":"2024-09-16T07:51:42.356497+0000","last_fullsized":"2024-09-16T07:51:42.356497+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":188,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.328832+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:42.328832+0000","last_peered":"2024-09-16T07:51:42.328832+0000","last_clean":"2024-09-16T07:51:42.328832+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:42.328832+0000","last_undegraded":"2024-09-16T07:51:42.328832+0000","last_fullsized":"2024-09-16T07:51:42.328832+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"71'640","reported_seq":682,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.124215+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:51:44.124215+0000","last_peered":"2024-09-16T07:51:44.124215+0000","last_clean":"2024-09-16T07:51:44.124215+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:51:44.124215+0000","last_undegraded":"2024-09-16T07:51:44.124215+0000","last_fullsized":"2024-09-16T07:51:44.124215+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.320647+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:42.320647+0000","last_peered":"2024-09-16T07:51:42.320647+0000","last_clean":"2024-09-16T07:51:42.320647+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:42.320647+0000","last_undegraded":"2024-09-16T07:51:42.320647+0000","last_fullsized":"2024-09-16T07:51:42.320647+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"71'646","reported_seq":688,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.754087+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:51:44.754087+0000","last_peered":"2024-09-16T07:51:44.754087+0000","last_clean":"2024-09-16T07:51:44.754087+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:51:44.754087+0000","last_undegraded":"2024-09-16T07:51:44.754087+0000","last_fullsized":"2024-09-16T07:51:44.754087+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5292032,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.367733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:42.367733+0000","last_peered":"2024-09-16T07:51:42.367733+0000","last_clean":"2024-09-16T07:51:42.367733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:42.367733+0000","last_undegraded":"2024-09-16T07:51:42.367733+0000","last_fullsized":"2024-09-16T07:51:42.367733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"71'648","reported_seq":690,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.234518+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:51:44.234518+0000","last_peered":"2024-09-16T07:51:44.234518+0000","last_clean":"2024-09-16T07:51:44.234518+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:51:44.234518+0000","last_undegraded":"2024-09-16T07:51:44.234518+0000","last_fullsized":"2024-09-16T07:51:44.234518+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":189,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.328641+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:42.328641+0000","last_peered":"2024-09-16T07:51:42.328641+0000","last_clean":"2024-09-16T07:51:42.328641+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:42.328641+0000","last_undegraded":"2024-09-16T07:51:42.328641+0000","last_fullsized":"2024-09-16T07:51:42.328641+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"71'496","reported_seq":538,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.124605+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:51:43.124605+0000","last_peered":"2024-09-16T07:51:43.124605+0000","last_clean":"2024-09-16T07:51:43.124605+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:51:43.124605+0000","last_undegraded":"2024-09-16T07:51:43.124605+0000","last_fullsized":"2024-09-16T07:51:43.124605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.359967+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:42.359967+0000","last_peered":"2024-09-16T07:51:42.359967+0000","last_clean":"2024-09-16T07:51:42.359967+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:42.359967+0000","last_undegraded":"2024-09-16T07:51:42.359967+0000","last_fullsized":"2024-09-16T07:51:42.359967+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"71'760","reported_seq":802,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.021920+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:51:44.021920+0000","last_peered":"2024-09-16T07:51:44.021920+0000","last_clean":"2024-09-16T07:51:44.021920+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:51:44.021920+0000","last_undegraded":"2024-09-16T07:51:44.021920+0000","last_fullsized":"2024-09-16T07:51:44.021920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.363130+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:42.363130+0000","last_peered":"2024-09-16T07:51:42.363130+0000","last_clean":"2024-09-16T07:51:42.363130+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:42.363130+0000","last_undegraded":"2024-09-16T07:51:42.363130+0000","last_fullsized":"2024-09-16T07:51:42.363130+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"70'608","reported_seq":650,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.327956+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:51:42.327956+0000","last_peered":"2024-09-16T07:51:42.327956+0000","last_clean":"2024-09-16T07:51:42.327956+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:51:42.327956+0000","last_undegraded":"2024-09-16T07:51:42.327956+0000","last_fullsized":"2024-09-16T07:51:42.327956+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.358546+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:42.358546+0000","last_peered":"2024-09-16T07:51:42.358546+0000","last_clean":"2024-09-16T07:51:42.358546+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:42.358546+0000","last_undegraded":"2024-09-16T07:51:42.358546+0000","last_fullsized":"2024-09-16T07:51:42.358546+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"71'784","reported_seq":826,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.169950+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:51:44.169950+0000","last_peered":"2024-09-16T07:51:44.169950+0000","last_clean":"2024-09-16T07:51:44.169950+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:51:44.169950+0000","last_undegraded":"2024-09-16T07:51:44.169950+0000","last_fullsized":"2024-09-16T07:51:44.169950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.321077+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:42.321077+0000","last_peered":"2024-09-16T07:51:42.321077+0000","last_clean":"2024-09-16T07:51:42.321077+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:42.321077+0000","last_undegraded":"2024-09-16T07:51:42.321077+0000","last_fullsized":"2024-09-16T07:51:42.321077+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":82296832,"num_objects":1256,"num_object_clones":0,"num_object_copies":3768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10046,"num_write_kb":80368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123437056,"data_stored":246874112,"data_compressed":12744198,"data_compressed_allocated":123437056,"data_compressed_original":246874112,"omap_allocated":0,"internal_metadata":0},"log_size":10046,"ondisk_log_size":10046,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":144744,"kb_used_data":23512,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94227096,"statfs":{"total":96636764160,"available":96488546304,"internally_reserved":0,"allocated":24076288,"data_stored":47148683,"data_compressed":2422270,"data_compressed_allocated":23461888,"data_compressed_original":46923776,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":155244,"kb_used_data":38172,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94216596,"statfs":{"total":96636764160,"available":96477794304,"internally_reserved":0,"allocated":39088128,"data_stored":77639851,"data_compressed":3995877,"data_compressed_allocated":38453248,"data_compressed_original":77398016,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134780,"kb_used_data":27436,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94237060,"statfs":{"total":96636764160,"available":96498749440,"internally_reserved":0,"allocated":28094464,"data_stored":55652523,"data_compressed":2860857,"data_compressed_allocated":27459584,"data_compressed_original":55410688,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157960,"kb_used_data":32568,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94213880,"statfs":{"total":96636764160,"available":96475013120,"internally_reserved":0,"allocated":33349632,"data_stored":66171032,"data_compressed":3403871,"data_compressed_allocated":32718848,"data_compressed_original":65929216,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33087488,"data_stored":66174976,"data_compressed":3416134,"data_compressed_allocated":33087488,"data_compressed_original":66174976,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27811840,"data_stored":55623680,"data_compressed":2871428,"data_compressed_allocated":27811840,"data_compressed_original":55623680,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38723584,"data_stored":77447168,"data_compressed":3997988,"data_compressed_allocated":38723584,"data_compressed_original":77447168,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23814144,"data_stored":47628288,"data_compressed":2458648,"data_compressed_allocated":23814144,"data_compressed_original":47628288,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:51:50.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 66 16 10974 10958 1.297 1.21875 0.0646477 0.0962982 2024-09-16T07:51:51.948 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:51.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 67 16 11137 11121 1.29664 1.27344 0.110957 0.0963136 2024-09-16T07:51:52.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:52.085+0000 7fbff4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:52.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:52.094+0000 7fbff4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:52.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 68 16 11295 11279 1.29573 1.23438 0.0817276 0.0963891 2024-09-16T07:51:53.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 69 16 11432 11416 1.29246 1.07031 0.109619 0.0966233 2024-09-16T07:51:54.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:54.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:54.505+0000 7fbef289c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:54.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:54.512+0000 7fbef289c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:54.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 70 16 11550 11534 1.28716 0.921875 0.135354 0.0970147 2024-09-16T07:51:55.453 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:51:55.453 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:51:55.454 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:51:55.454 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:51:55.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:55.593+0000 7f5782b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:55.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:55.603+0000 7f5782b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:55.655 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:55.656 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:55.658 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:55.659 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:55.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:51:55.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:55.801+0000 7fc49ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:55.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:55.815+0000 7fc49ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:55.943 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:55.943 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:55.943 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:55.943 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:55.943 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:55.946 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:55.947 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:55.947 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:51:55.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 71 16 11716 11700 1.2873 1.29688 0.168067 0.0969662 2024-09-16T07:51:56.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:56.102+0000 7f13f36c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:56.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:56.114+0000 7f13f36c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:56.213 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:56.213 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:56.213 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:56.214 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:56.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:56.217 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:56.217 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:51:56.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:56.371+0000 7f09d60bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:56.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:56.384+0000 7f09d60bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:56.407 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:51:56.408 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:51:56.410 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:51:56.411 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:51:56.835 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:51:56.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:56.977+0000 7ff07ea9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:56.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:56.986+0000 7ff07ea9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:56.992 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 72 16 11858 11842 1.28483 1.10938 0.0965128 0.0971963 2024-09-16T07:51:57.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 73 16 12012 11996 1.2837 1.20312 0.107225 0.0972435 2024-09-16T07:51:58.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 74 16 12154 12138 1.28135 1.10938 0.146133 0.097444 2024-09-16T07:51:59.302 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:51:59.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:59.435+0000 7fe8b5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:59.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:51:59.444+0000 7fe8b5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:51:59.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 75 16 12309 12293 1.28041 1.21094 0.0393996 0.0975557 2024-09-16T07:52:00.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 76 16 12426 12410 1.27558 0.914062 0.118142 0.0978839 2024-09-16T07:52:01.412 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:01.412 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:01.412 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:01.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:01.549+0000 7f470a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:01.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:01.564+0000 7f470a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:01.855 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:52:01.856 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:52:01.872 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":433,"stamp":"2024-09-16T07:52:01.840637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82887219,"num_objects":1260,"num_object_clones":0,"num_object_copies":3780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10127,"num_write_kb":81476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10101,"ondisk_log_size":10101,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":592728,"kb_used_data":121688,"kb_used_omap":0,"kb_used_meta":470976,"kb_avail":376894632,"statfs":{"total":386547056640,"available":385940103168,"internally_reserved":0,"allocated":124608512,"data_stored":246612089,"data_compressed":12682875,"data_compressed_allocated":122093568,"data_compressed_original":245661696,"omap_allocated":0,"internal_metadata":482279424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002261"},"pg_stats":[{"pgid":"9.7","version":"71'648","reported_seq":690,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.351999+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:51:44.351999+0000","last_peered":"2024-09-16T07:51:44.351999+0000","last_clean":"2024-09-16T07:51:44.351999+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:51:44.351999+0000","last_undegraded":"2024-09-16T07:51:44.351999+0000","last_fullsized":"2024-09-16T07:51:44.351999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"71'552","reported_seq":594,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.288452+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:51:44.288452+0000","last_peered":"2024-09-16T07:51:44.288452+0000","last_clean":"2024-09-16T07:51:44.288452+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:51:44.288452+0000","last_undegraded":"2024-09-16T07:51:44.288452+0000","last_fullsized":"2024-09-16T07:51:44.288452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"71'576","reported_seq":618,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.705599+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:51:44.705599+0000","last_peered":"2024-09-16T07:51:44.705599+0000","last_clean":"2024-09-16T07:51:44.705599+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:51:44.705599+0000","last_undegraded":"2024-09-16T07:51:44.705599+0000","last_fullsized":"2024-09-16T07:51:44.705599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"71'616","reported_seq":658,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.703663+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:51:44.703663+0000","last_peered":"2024-09-16T07:51:44.703663+0000","last_clean":"2024-09-16T07:51:44.703663+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:51:44.703663+0000","last_undegraded":"2024-09-16T07:51:44.703663+0000","last_fullsized":"2024-09-16T07:51:44.703663+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"71'592","reported_seq":634,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.632045+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:51:43.632045+0000","last_peered":"2024-09-16T07:51:43.632045+0000","last_clean":"2024-09-16T07:51:43.632045+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:51:43.632045+0000","last_undegraded":"2024-09-16T07:51:43.632045+0000","last_fullsized":"2024-09-16T07:51:43.632045+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"71'672","reported_seq":714,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.552159+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:51:44.552159+0000","last_peered":"2024-09-16T07:51:44.552159+0000","last_clean":"2024-09-16T07:51:44.552159+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:51:44.552159+0000","last_undegraded":"2024-09-16T07:51:44.552159+0000","last_fullsized":"2024-09-16T07:51:44.552159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"71'688","reported_seq":730,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.623397+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:51:44.623397+0000","last_peered":"2024-09-16T07:51:44.623397+0000","last_clean":"2024-09-16T07:51:44.623397+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:51:44.623397+0000","last_undegraded":"2024-09-16T07:51:44.623397+0000","last_fullsized":"2024-09-16T07:51:44.623397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"71'528","reported_seq":570,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.343608+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:51:43.343608+0000","last_peered":"2024-09-16T07:51:43.343608+0000","last_clean":"2024-09-16T07:51:43.343608+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:51:43.343608+0000","last_undegraded":"2024-09-16T07:51:43.343608+0000","last_fullsized":"2024-09-16T07:51:43.343608+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"71'592","reported_seq":634,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.409184+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:51:44.409184+0000","last_peered":"2024-09-16T07:51:44.409184+0000","last_clean":"2024-09-16T07:51:44.409184+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:51:44.409184+0000","last_undegraded":"2024-09-16T07:51:44.409184+0000","last_fullsized":"2024-09-16T07:51:44.409184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":256,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.356497+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:42.356497+0000","last_peered":"2024-09-16T07:51:42.356497+0000","last_clean":"2024-09-16T07:51:42.356497+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:42.356497+0000","last_undegraded":"2024-09-16T07:51:42.356497+0000","last_fullsized":"2024-09-16T07:51:42.356497+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":188,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.328832+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:42.328832+0000","last_peered":"2024-09-16T07:51:42.328832+0000","last_clean":"2024-09-16T07:51:42.328832+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:42.328832+0000","last_undegraded":"2024-09-16T07:51:42.328832+0000","last_fullsized":"2024-09-16T07:51:42.328832+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"71'640","reported_seq":682,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.124215+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:51:44.124215+0000","last_peered":"2024-09-16T07:51:44.124215+0000","last_clean":"2024-09-16T07:51:44.124215+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:51:44.124215+0000","last_undegraded":"2024-09-16T07:51:44.124215+0000","last_fullsized":"2024-09-16T07:51:44.124215+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.320647+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:42.320647+0000","last_peered":"2024-09-16T07:51:42.320647+0000","last_clean":"2024-09-16T07:51:42.320647+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:42.320647+0000","last_undegraded":"2024-09-16T07:51:42.320647+0000","last_fullsized":"2024-09-16T07:51:42.320647+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"71'646","reported_seq":688,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.754087+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:51:44.754087+0000","last_peered":"2024-09-16T07:51:44.754087+0000","last_clean":"2024-09-16T07:51:44.754087+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:51:44.754087+0000","last_undegraded":"2024-09-16T07:51:44.754087+0000","last_fullsized":"2024-09-16T07:51:44.754087+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5292032,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.367733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:42.367733+0000","last_peered":"2024-09-16T07:51:42.367733+0000","last_clean":"2024-09-16T07:51:42.367733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:42.367733+0000","last_undegraded":"2024-09-16T07:51:42.367733+0000","last_fullsized":"2024-09-16T07:51:42.367733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"71'648","reported_seq":690,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.234518+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:51:44.234518+0000","last_peered":"2024-09-16T07:51:44.234518+0000","last_clean":"2024-09-16T07:51:44.234518+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:51:44.234518+0000","last_undegraded":"2024-09-16T07:51:44.234518+0000","last_fullsized":"2024-09-16T07:51:44.234518+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":189,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.328641+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:42.328641+0000","last_peered":"2024-09-16T07:51:42.328641+0000","last_clean":"2024-09-16T07:51:42.328641+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:42.328641+0000","last_undegraded":"2024-09-16T07:51:42.328641+0000","last_fullsized":"2024-09-16T07:51:42.328641+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"71'496","reported_seq":538,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.124605+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:51:43.124605+0000","last_peered":"2024-09-16T07:51:43.124605+0000","last_clean":"2024-09-16T07:51:43.124605+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:51:43.124605+0000","last_undegraded":"2024-09-16T07:51:43.124605+0000","last_fullsized":"2024-09-16T07:51:43.124605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.359967+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:42.359967+0000","last_peered":"2024-09-16T07:51:42.359967+0000","last_clean":"2024-09-16T07:51:42.359967+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:42.359967+0000","last_undegraded":"2024-09-16T07:51:42.359967+0000","last_fullsized":"2024-09-16T07:51:42.359967+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"71'760","reported_seq":802,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.021920+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:51:44.021920+0000","last_peered":"2024-09-16T07:51:44.021920+0000","last_clean":"2024-09-16T07:51:44.021920+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:51:44.021920+0000","last_undegraded":"2024-09-16T07:51:44.021920+0000","last_fullsized":"2024-09-16T07:51:44.021920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.363130+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:42.363130+0000","last_peered":"2024-09-16T07:51:42.363130+0000","last_clean":"2024-09-16T07:51:42.363130+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:42.363130+0000","last_undegraded":"2024-09-16T07:51:42.363130+0000","last_fullsized":"2024-09-16T07:51:42.363130+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"70'608","reported_seq":650,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.327956+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:51:42.327956+0000","last_peered":"2024-09-16T07:51:42.327956+0000","last_clean":"2024-09-16T07:51:42.327956+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:51:42.327956+0000","last_undegraded":"2024-09-16T07:51:42.327956+0000","last_fullsized":"2024-09-16T07:51:42.327956+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.358546+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:42.358546+0000","last_peered":"2024-09-16T07:51:42.358546+0000","last_clean":"2024-09-16T07:51:42.358546+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:42.358546+0000","last_undegraded":"2024-09-16T07:51:42.358546+0000","last_fullsized":"2024-09-16T07:51:42.358546+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"71'784","reported_seq":826,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.169950+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:51:44.169950+0000","last_peered":"2024-09-16T07:51:44.169950+0000","last_clean":"2024-09-16T07:51:44.169950+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:51:44.169950+0000","last_undegraded":"2024-09-16T07:51:44.169950+0000","last_fullsized":"2024-09-16T07:51:44.169950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.321077+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:42.321077+0000","last_peered":"2024-09-16T07:51:42.321077+0000","last_clean":"2024-09-16T07:51:42.321077+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:42.321077+0000","last_undegraded":"2024-09-16T07:51:42.321077+0000","last_fullsized":"2024-09-16T07:51:42.321077+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":82296832,"num_objects":1256,"num_object_clones":0,"num_object_copies":3768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10046,"num_write_kb":80368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123437056,"data_stored":246874112,"data_compressed":12744198,"data_compressed_allocated":123437056,"data_compressed_original":246874112,"omap_allocated":0,"internal_metadata":0},"log_size":10046,"ondisk_log_size":10046,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":144744,"kb_used_data":23512,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94227096,"statfs":{"total":96636764160,"available":96488546304,"internally_reserved":0,"allocated":24076288,"data_stored":47148683,"data_compressed":2422270,"data_compressed_allocated":23461888,"data_compressed_original":46923776,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":155244,"kb_used_data":38172,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94216596,"statfs":{"total":96636764160,"available":96477794304,"internally_reserved":0,"allocated":39088128,"data_stored":77639851,"data_compressed":3995877,"data_compressed_allocated":38453248,"data_compressed_original":77398016,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134780,"kb_used_data":27436,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94237060,"statfs":{"total":96636764160,"available":96498749440,"internally_reserved":0,"allocated":28094464,"data_stored":55652523,"data_compressed":2860857,"data_compressed_allocated":27459584,"data_compressed_original":55410688,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157960,"kb_used_data":32568,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94213880,"statfs":{"total":96636764160,"available":96475013120,"internally_reserved":0,"allocated":33349632,"data_stored":66171032,"data_compressed":3403871,"data_compressed_allocated":32718848,"data_compressed_original":65929216,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33087488,"data_stored":66174976,"data_compressed":3416134,"data_compressed_allocated":33087488,"data_compressed_original":66174976,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27811840,"data_stored":55623680,"data_compressed":2871428,"data_compressed_allocated":27811840,"data_compressed_original":55623680,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38723584,"data_stored":77447168,"data_compressed":3997988,"data_compressed_allocated":38723584,"data_compressed_original":77447168,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23814144,"data_stored":47628288,"data_compressed":2458648,"data_compressed_allocated":23814144,"data_compressed_original":47628288,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:01.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:01.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 77 16 12576 12560 1.27424 1.17188 0.0784073 0.0980119 2024-09-16T07:52:02.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:02.044+0000 7f7604391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:02.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:02.051+0000 7f7604391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:02.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 78 16 12723 12707 1.27262 1.14844 0.188551 0.0981236 2024-09-16T07:52:03.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 79 16 12858 12842 1.26986 1.05469 0.0842764 0.0983641 2024-09-16T07:52:04.416 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:04.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:04.552+0000 7fa2716d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:04.560+0000 7fa2716d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:04.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:52:04.995184+0000 min lat: 0.0152416 max lat: 0.31218 avg lat: 0.0985335 2024-09-16T07:52:04.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:52:04.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 80 16 12999 12983 1.26776 1.10156 0.096125 0.0985335 2024-09-16T07:52:05.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 81 16 13158 13142 1.26744 1.24219 0.0589928 0.0985255 2024-09-16T07:52:06.774 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:06.875 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:06.875 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:06.875 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:06.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:06.916+0000 7fe1fdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:06.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:06.923+0000 7fe1fdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:06.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 82 16 13305 13289 1.26599 1.14844 0.0719958 0.0986757 2024-09-16T07:52:07.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:07.003+0000 7f972a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:07.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:07.013+0000 7f972a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:07.351 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:52:07.352 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:52:07.374 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2024-09-16T07:52:05.841369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82887219,"num_objects":1260,"num_object_clones":0,"num_object_copies":3780,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10127,"num_write_kb":81476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10101,"ondisk_log_size":10101,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":592728,"kb_used_data":121688,"kb_used_omap":0,"kb_used_meta":470976,"kb_avail":376894632,"statfs":{"total":386547056640,"available":385940103168,"internally_reserved":0,"allocated":124608512,"data_stored":246612089,"data_compressed":12682875,"data_compressed_allocated":122093568,"data_compressed_original":245661696,"omap_allocated":0,"internal_metadata":482279424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002164"},"pg_stats":[{"pgid":"9.7","version":"71'648","reported_seq":690,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.351999+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:51:44.351999+0000","last_peered":"2024-09-16T07:51:44.351999+0000","last_clean":"2024-09-16T07:51:44.351999+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:51:44.351999+0000","last_undegraded":"2024-09-16T07:51:44.351999+0000","last_fullsized":"2024-09-16T07:51:44.351999+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"71'552","reported_seq":594,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.288452+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:51:44.288452+0000","last_peered":"2024-09-16T07:51:44.288452+0000","last_clean":"2024-09-16T07:51:44.288452+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:51:44.288452+0000","last_undegraded":"2024-09-16T07:51:44.288452+0000","last_fullsized":"2024-09-16T07:51:44.288452+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"71'576","reported_seq":618,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.705599+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:51:44.705599+0000","last_peered":"2024-09-16T07:51:44.705599+0000","last_clean":"2024-09-16T07:51:44.705599+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:51:44.705599+0000","last_undegraded":"2024-09-16T07:51:44.705599+0000","last_fullsized":"2024-09-16T07:51:44.705599+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718592,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":576,"num_write_kb":4608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"71'616","reported_seq":658,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.703663+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:51:44.703663+0000","last_peered":"2024-09-16T07:51:44.703663+0000","last_clean":"2024-09-16T07:51:44.703663+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:51:44.703663+0000","last_undegraded":"2024-09-16T07:51:44.703663+0000","last_fullsized":"2024-09-16T07:51:44.703663+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5046272,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":4928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"71'592","reported_seq":634,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.632045+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:51:43.632045+0000","last_peered":"2024-09-16T07:51:43.632045+0000","last_clean":"2024-09-16T07:51:43.632045+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:51:43.632045+0000","last_undegraded":"2024-09-16T07:51:43.632045+0000","last_fullsized":"2024-09-16T07:51:43.632045+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"71'672","reported_seq":714,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.552159+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:51:44.552159+0000","last_peered":"2024-09-16T07:51:44.552159+0000","last_clean":"2024-09-16T07:51:44.552159+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:51:44.552159+0000","last_undegraded":"2024-09-16T07:51:44.552159+0000","last_fullsized":"2024-09-16T07:51:44.552159+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":672,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"71'688","reported_seq":730,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.623397+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:51:44.623397+0000","last_peered":"2024-09-16T07:51:44.623397+0000","last_clean":"2024-09-16T07:51:44.623397+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:51:44.623397+0000","last_undegraded":"2024-09-16T07:51:44.623397+0000","last_fullsized":"2024-09-16T07:51:44.623397+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":688,"num_write_kb":5504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"71'528","reported_seq":570,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.343608+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:51:43.343608+0000","last_peered":"2024-09-16T07:51:43.343608+0000","last_clean":"2024-09-16T07:51:43.343608+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:51:43.343608+0000","last_undegraded":"2024-09-16T07:51:43.343608+0000","last_fullsized":"2024-09-16T07:51:43.343608+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4325376,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":4224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"71'592","reported_seq":634,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.409184+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:51:44.409184+0000","last_peered":"2024-09-16T07:51:44.409184+0000","last_clean":"2024-09-16T07:51:44.409184+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:51:44.409184+0000","last_undegraded":"2024-09-16T07:51:44.409184+0000","last_fullsized":"2024-09-16T07:51:44.409184+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4849664,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":592,"num_write_kb":4736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":256,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.356497+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:42.356497+0000","last_peered":"2024-09-16T07:51:42.356497+0000","last_clean":"2024-09-16T07:51:42.356497+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:42.356497+0000","last_undegraded":"2024-09-16T07:51:42.356497+0000","last_fullsized":"2024-09-16T07:51:42.356497+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":188,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.328832+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:42.328832+0000","last_peered":"2024-09-16T07:51:42.328832+0000","last_clean":"2024-09-16T07:51:42.328832+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:42.328832+0000","last_undegraded":"2024-09-16T07:51:42.328832+0000","last_fullsized":"2024-09-16T07:51:42.328832+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"71'640","reported_seq":682,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.124215+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:51:44.124215+0000","last_peered":"2024-09-16T07:51:44.124215+0000","last_clean":"2024-09-16T07:51:44.124215+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:51:44.124215+0000","last_undegraded":"2024-09-16T07:51:44.124215+0000","last_fullsized":"2024-09-16T07:51:44.124215+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":640,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.320647+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:42.320647+0000","last_peered":"2024-09-16T07:51:42.320647+0000","last_clean":"2024-09-16T07:51:42.320647+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:42.320647+0000","last_undegraded":"2024-09-16T07:51:42.320647+0000","last_fullsized":"2024-09-16T07:51:42.320647+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"71'646","reported_seq":688,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.754087+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:51:44.754087+0000","last_peered":"2024-09-16T07:51:44.754087+0000","last_clean":"2024-09-16T07:51:44.754087+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:51:44.754087+0000","last_undegraded":"2024-09-16T07:51:44.754087+0000","last_fullsized":"2024-09-16T07:51:44.754087+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5292032,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.367733+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:42.367733+0000","last_peered":"2024-09-16T07:51:42.367733+0000","last_clean":"2024-09-16T07:51:42.367733+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:42.367733+0000","last_undegraded":"2024-09-16T07:51:42.367733+0000","last_fullsized":"2024-09-16T07:51:42.367733+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"71'648","reported_seq":690,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.234518+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:51:44.234518+0000","last_peered":"2024-09-16T07:51:44.234518+0000","last_clean":"2024-09-16T07:51:44.234518+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:51:44.234518+0000","last_undegraded":"2024-09-16T07:51:44.234518+0000","last_fullsized":"2024-09-16T07:51:44.234518+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":5184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":189,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.328641+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:42.328641+0000","last_peered":"2024-09-16T07:51:42.328641+0000","last_clean":"2024-09-16T07:51:42.328641+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:42.328641+0000","last_undegraded":"2024-09-16T07:51:42.328641+0000","last_fullsized":"2024-09-16T07:51:42.328641+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"71'496","reported_seq":538,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:43.124605+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:51:43.124605+0000","last_peered":"2024-09-16T07:51:43.124605+0000","last_clean":"2024-09-16T07:51:43.124605+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:51:43.124605+0000","last_undegraded":"2024-09-16T07:51:43.124605+0000","last_fullsized":"2024-09-16T07:51:43.124605+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.359967+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:42.359967+0000","last_peered":"2024-09-16T07:51:42.359967+0000","last_clean":"2024-09-16T07:51:42.359967+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:42.359967+0000","last_undegraded":"2024-09-16T07:51:42.359967+0000","last_fullsized":"2024-09-16T07:51:42.359967+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"71'760","reported_seq":802,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.021920+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:51:44.021920+0000","last_peered":"2024-09-16T07:51:44.021920+0000","last_clean":"2024-09-16T07:51:44.021920+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:51:44.021920+0000","last_undegraded":"2024-09-16T07:51:44.021920+0000","last_fullsized":"2024-09-16T07:51:44.021920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":6080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.363130+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:42.363130+0000","last_peered":"2024-09-16T07:51:42.363130+0000","last_clean":"2024-09-16T07:51:42.363130+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:42.363130+0000","last_undegraded":"2024-09-16T07:51:42.363130+0000","last_fullsized":"2024-09-16T07:51:42.363130+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"70'608","reported_seq":650,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.327956+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:51:42.327956+0000","last_peered":"2024-09-16T07:51:42.327956+0000","last_clean":"2024-09-16T07:51:42.327956+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:51:42.327956+0000","last_undegraded":"2024-09-16T07:51:42.327956+0000","last_fullsized":"2024-09-16T07:51:42.327956+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4980736,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":608,"num_write_kb":4864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.358546+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:42.358546+0000","last_peered":"2024-09-16T07:51:42.358546+0000","last_clean":"2024-09-16T07:51:42.358546+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:42.358546+0000","last_undegraded":"2024-09-16T07:51:42.358546+0000","last_fullsized":"2024-09-16T07:51:42.358546+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"71'784","reported_seq":826,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:44.169950+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:51:44.169950+0000","last_peered":"2024-09-16T07:51:44.169950+0000","last_clean":"2024-09-16T07:51:44.169950+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:51:44.169950+0000","last_undegraded":"2024-09-16T07:51:44.169950+0000","last_fullsized":"2024-09-16T07:51:44.169950+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":784,"num_write_kb":6272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":187,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T07:51:42.321077+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:42.321077+0000","last_peered":"2024-09-16T07:51:42.321077+0000","last_clean":"2024-09-16T07:51:42.321077+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:42.321077+0000","last_undegraded":"2024-09-16T07:51:42.321077+0000","last_fullsized":"2024-09-16T07:51:42.321077+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":82296832,"num_objects":1256,"num_object_clones":0,"num_object_copies":3768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10046,"num_write_kb":80368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123437056,"data_stored":246874112,"data_compressed":12744198,"data_compressed_allocated":123437056,"data_compressed_original":246874112,"omap_allocated":0,"internal_metadata":0},"log_size":10046,"ondisk_log_size":10046,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":144744,"kb_used_data":23512,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94227096,"statfs":{"total":96636764160,"available":96488546304,"internally_reserved":0,"allocated":24076288,"data_stored":47148683,"data_compressed":2422270,"data_compressed_allocated":23461888,"data_compressed_original":46923776,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":155244,"kb_used_data":38172,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94216596,"statfs":{"total":96636764160,"available":96477794304,"internally_reserved":0,"allocated":39088128,"data_stored":77639851,"data_compressed":3995877,"data_compressed_allocated":38453248,"data_compressed_original":77398016,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134780,"kb_used_data":27436,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94237060,"statfs":{"total":96636764160,"available":96498749440,"internally_reserved":0,"allocated":28094464,"data_stored":55652523,"data_compressed":2860857,"data_compressed_allocated":27459584,"data_compressed_original":55410688,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157960,"kb_used_data":32568,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94213880,"statfs":{"total":96636764160,"available":96475013120,"internally_reserved":0,"allocated":33349632,"data_stored":66171032,"data_compressed":3403871,"data_compressed_allocated":32718848,"data_compressed_original":65929216,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33087488,"data_stored":66174976,"data_compressed":3416134,"data_compressed_allocated":33087488,"data_compressed_original":66174976,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27811840,"data_stored":55623680,"data_compressed":2871428,"data_compressed_allocated":27811840,"data_compressed_original":55623680,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38723584,"data_stored":77447168,"data_compressed":3997988,"data_compressed_allocated":38723584,"data_compressed_original":77447168,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23814144,"data_stored":47628288,"data_compressed":2458648,"data_compressed_allocated":23814144,"data_compressed_original":47628288,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:07.993 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 83 16 13444 13428 1.26382 1.08594 0.0891944 0.0988406 2024-09-16T07:52:08.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 84 16 13600 13584 1.26328 1.21875 0.0990287 0.0988711 2024-09-16T07:52:09.281 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:09.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:09.440+0000 7fefe88a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:09.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:09.452+0000 7fefe88a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:09.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 85 16 13739 13723 1.26119 1.08594 0.138291 0.0990539 2024-09-16T07:52:10.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 86 16 13887 13871 1.25997 1.15625 0.0873219 0.0991222 2024-09-16T07:52:11.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 87 16 14032 14016 1.25851 1.13281 0.0828156 0.0992583 2024-09-16T07:52:12.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:12.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:12.176+0000 7fbd2acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:12.183+0000 7fbd2acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.375 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:12.376 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:12.376 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:52:12.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:52:12.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:12.524+0000 7f229b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:12.535+0000 7f229b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:12.576 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:12.576 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:12.576 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:12.576 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:12.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:12.578 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:12.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:52:12.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:12.695+0000 7fc1db551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:12.706+0000 7fc1db551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:12.738 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:12.741 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:12.741 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:12.742 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:52:12.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:12.876+0000 7f900fcfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:12.889+0000 7f900fcfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:12.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 88 16 14175 14159 1.2569 1.11719 0.294054 0.09938 2024-09-16T07:52:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:13.017 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:13.018 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:13.020 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:13.020 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:13.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:52:13.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:13.158+0000 7f5005b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:13.173+0000 7f5005b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:13.201 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:13.202 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:13.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:13.205 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:13.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 89 16 14315 14299 1.25507 1.09375 0.0691524 0.0995484 2024-09-16T07:52:14.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:14.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:14.592+0000 7f01910fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:14.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:14.598+0000 7f01910fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:14.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 90 14 14458 14444 1.25371 1.13281 0.0905621 0.0996565 2024-09-16T07:52:15.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total time run: 90.1308 2024-09-16T07:52:15.994 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total writes made: 14458 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Write size: 8192 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object size: 65536 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Bandwidth (MB/sec): 1.25321 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Bandwidth: 0.133758 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max bandwidth (MB/sec): 1.5625 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min bandwidth (MB/sec): 0.914062 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average IOPS: 160 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev IOPS: 17.121 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max IOPS: 200 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min IOPS: 117 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average Latency(s): 0.0996741 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Latency(s): 0.0406665 2024-09-16T07:52:15.995 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max latency(s): 0.31218 2024-09-16T07:52:15.996 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min latency(s): 0.0152416 2024-09-16T07:52:16.022 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:52:17.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:17.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:17.209+0000 7f870bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:17.219+0000 7f870bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:18.206 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:18.207 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:18.207 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:52:18.207 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:52:18.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:18.366+0000 7f9a47b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:18.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:18.383+0000 7f9a47b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:18.438 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:18.438 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:18.438 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:18.438 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:18.438 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:18.438 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:18.438 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:18.438 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:18.444 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:18.444 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:18.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:52:18.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:18.598+0000 7fe3d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:18.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:18.614+0000 7fe3d3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:18.805 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:18.805 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:18.805 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:18.805 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:18.808 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:18.809 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:18.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:52:18.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:18.969+0000 7fa2ee2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:18.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:18.987+0000 7fa2ee2a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:19.236 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:19.237 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:19.240 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:19.241 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:19.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:52:19.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:19.403+0000 7fcc67591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:19.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:19.419+0000 7fcc67591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:19.437 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:19.438 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:19.438 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:19.438 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:19.438 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:19.438 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:19.438 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:19.440 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:19.441 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:19.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:19.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:19.835+0000 7f6e15f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:19.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:19.842+0000 7f6e15f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:22.489 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:22.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:22.660+0000 7f545ac93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:22.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:22.669+0000 7f545ac93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:24.442 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:24.442 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:24.442 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:24.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:24.591+0000 7f525327d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:24.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:24.608+0000 7f525327d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:24.871 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:52:24.872 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:52:24.895 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-09-16T07:52:23.845013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":118645299,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14492,"num_write_kb":116396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14466,"ondisk_log_size":14466,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":671732,"kb_used_data":174320,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376815628,"statfs":{"total":386547056640,"available":385859203072,"internally_reserved":0,"allocated":178503680,"data_stored":354349949,"data_compressed":18245322,"data_compressed_allocated":175955968,"data_compressed_original":353386496,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":35758080,"num_objects":546,"num_object_clones":0,"num_object_copies":1638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4365,"num_write_kb":34920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002458"},"pg_stats":[{"pgid":"9.7","version":"72'912","reported_seq":957,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:13.874854+0000","last_change":"2024-09-16T07:50:44.063678+0000","last_active":"2024-09-16T07:52:13.874854+0000","last_peered":"2024-09-16T07:52:13.874854+0000","last_clean":"2024-09-16T07:52:13.874854+0000","last_became_active":"2024-09-16T07:50:44.055360+0000","last_became_peered":"2024-09-16T07:50:44.055360+0000","last_unstale":"2024-09-16T07:52:13.874854+0000","last_undegraded":"2024-09-16T07:52:13.874854+0000","last_fullsized":"2024-09-16T07:52:13.874854+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"72'928","reported_seq":973,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.164749+0000","last_change":"2024-09-16T07:50:44.051676+0000","last_active":"2024-09-16T07:52:14.164749+0000","last_peered":"2024-09-16T07:52:14.164749+0000","last_clean":"2024-09-16T07:52:14.164749+0000","last_became_active":"2024-09-16T07:50:44.035763+0000","last_became_peered":"2024-09-16T07:50:44.035763+0000","last_unstale":"2024-09-16T07:52:14.164749+0000","last_undegraded":"2024-09-16T07:52:14.164749+0000","last_fullsized":"2024-09-16T07:52:14.164749+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"72'832","reported_seq":877,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.623308+0000","last_change":"2024-09-16T07:50:44.025761+0000","last_active":"2024-09-16T07:52:14.623308+0000","last_peered":"2024-09-16T07:52:14.623308+0000","last_clean":"2024-09-16T07:52:14.623308+0000","last_became_active":"2024-09-16T07:50:44.013566+0000","last_became_peered":"2024-09-16T07:50:44.013566+0000","last_unstale":"2024-09-16T07:52:14.623308+0000","last_undegraded":"2024-09-16T07:52:14.623308+0000","last_fullsized":"2024-09-16T07:52:14.623308+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"72'867","reported_seq":912,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.758069+0000","last_change":"2024-09-16T07:50:44.133216+0000","last_active":"2024-09-16T07:52:14.758069+0000","last_peered":"2024-09-16T07:52:14.758069+0000","last_clean":"2024-09-16T07:52:14.758069+0000","last_became_active":"2024-09-16T07:50:44.126575+0000","last_became_peered":"2024-09-16T07:50:44.126575+0000","last_unstale":"2024-09-16T07:52:14.758069+0000","last_undegraded":"2024-09-16T07:52:14.758069+0000","last_fullsized":"2024-09-16T07:52:14.758069+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7102464,"num_objects":109,"num_object_clones":0,"num_object_copies":327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":6936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"72'816","reported_seq":861,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.707039+0000","last_change":"2024-09-16T07:50:44.057770+0000","last_active":"2024-09-16T07:52:14.707039+0000","last_peered":"2024-09-16T07:52:14.707039+0000","last_clean":"2024-09-16T07:52:14.707039+0000","last_became_active":"2024-09-16T07:50:44.049507+0000","last_became_peered":"2024-09-16T07:50:44.049507+0000","last_unstale":"2024-09-16T07:52:14.707039+0000","last_undegraded":"2024-09-16T07:52:14.707039+0000","last_fullsized":"2024-09-16T07:52:14.707039+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":816,"num_write_kb":6528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"72'944","reported_seq":989,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:13.328818+0000","last_change":"2024-09-16T07:50:44.074060+0000","last_active":"2024-09-16T07:52:13.328818+0000","last_peered":"2024-09-16T07:52:13.328818+0000","last_clean":"2024-09-16T07:52:13.328818+0000","last_became_active":"2024-09-16T07:50:44.067555+0000","last_became_peered":"2024-09-16T07:50:44.067555+0000","last_unstale":"2024-09-16T07:52:13.328818+0000","last_undegraded":"2024-09-16T07:52:13.328818+0000","last_fullsized":"2024-09-16T07:52:13.328818+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":944,"log_dups_size":0,"ondisk_log_size":944,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":944,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"72'880","reported_seq":925,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:12.659882+0000","last_change":"2024-09-16T07:50:44.013560+0000","last_active":"2024-09-16T07:52:12.659882+0000","last_peered":"2024-09-16T07:52:12.659882+0000","last_clean":"2024-09-16T07:52:12.659882+0000","last_became_active":"2024-09-16T07:50:44.006909+0000","last_became_peered":"2024-09-16T07:50:44.006909+0000","last_unstale":"2024-09-16T07:52:12.659882+0000","last_undegraded":"2024-09-16T07:52:12.659882+0000","last_fullsized":"2024-09-16T07:52:12.659882+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7208960,"num_objects":110,"num_object_clones":0,"num_object_copies":330,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":880,"num_write_kb":7040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.0","version":"72'800","reported_seq":845,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.712170+0000","last_change":"2024-09-16T07:50:44.037881+0000","last_active":"2024-09-16T07:52:14.712170+0000","last_peered":"2024-09-16T07:52:14.712170+0000","last_clean":"2024-09-16T07:52:14.712170+0000","last_became_active":"2024-09-16T07:50:44.025398+0000","last_became_peered":"2024-09-16T07:50:44.025398+0000","last_unstale":"2024-09-16T07:52:14.712170+0000","last_undegraded":"2024-09-16T07:52:14.712170+0000","last_fullsized":"2024-09-16T07:52:14.712170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553600,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":800,"num_write_kb":6400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"72'912","reported_seq":957,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:13.663092+0000","last_change":"2024-09-16T07:50:44.053386+0000","last_active":"2024-09-16T07:52:13.663092+0000","last_peered":"2024-09-16T07:52:13.663092+0000","last_clean":"2024-09-16T07:52:13.663092+0000","last_became_active":"2024-09-16T07:50:44.044086+0000","last_became_peered":"2024-09-16T07:50:44.044086+0000","last_unstale":"2024-09-16T07:52:13.663092+0000","last_undegraded":"2024-09-16T07:52:13.663092+0000","last_fullsized":"2024-09-16T07:52:13.663092+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.319172+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:47.319172+0000","last_peered":"2024-09-16T07:51:47.319172+0000","last_clean":"2024-09-16T07:51:47.319172+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:47.319172+0000","last_undegraded":"2024-09-16T07:51:47.319172+0000","last_fullsized":"2024-09-16T07:51:47.319172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":191,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.321991+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:47.321991+0000","last_peered":"2024-09-16T07:51:47.321991+0000","last_clean":"2024-09-16T07:51:47.321991+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:47.321991+0000","last_undegraded":"2024-09-16T07:51:47.321991+0000","last_fullsized":"2024-09-16T07:51:47.321991+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"72'896","reported_seq":941,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.478687+0000","last_change":"2024-09-16T07:50:44.091959+0000","last_active":"2024-09-16T07:52:14.478687+0000","last_peered":"2024-09-16T07:52:14.478687+0000","last_clean":"2024-09-16T07:52:14.478687+0000","last_became_active":"2024-09-16T07:50:44.086074+0000","last_became_peered":"2024-09-16T07:50:44.086074+0000","last_unstale":"2024-09-16T07:52:14.478687+0000","last_undegraded":"2024-09-16T07:52:14.478687+0000","last_fullsized":"2024-09-16T07:52:14.478687+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.319366+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:47.319366+0000","last_peered":"2024-09-16T07:51:47.319366+0000","last_clean":"2024-09-16T07:51:47.319366+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:47.319366+0000","last_undegraded":"2024-09-16T07:51:47.319366+0000","last_fullsized":"2024-09-16T07:51:47.319366+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"72'888","reported_seq":933,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:12.558746+0000","last_change":"2024-09-16T07:50:44.031023+0000","last_active":"2024-09-16T07:52:12.558746+0000","last_peered":"2024-09-16T07:52:12.558746+0000","last_clean":"2024-09-16T07:52:12.558746+0000","last_became_active":"2024-09-16T07:50:44.025205+0000","last_became_peered":"2024-09-16T07:50:44.025205+0000","last_unstale":"2024-09-16T07:52:12.558746+0000","last_undegraded":"2024-09-16T07:52:12.558746+0000","last_fullsized":"2024-09-16T07:52:12.558746+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":7104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.353414+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:47.353414+0000","last_peered":"2024-09-16T07:51:47.353414+0000","last_clean":"2024-09-16T07:51:47.353414+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:47.353414+0000","last_undegraded":"2024-09-16T07:51:47.353414+0000","last_fullsized":"2024-09-16T07:51:47.353414+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"72'912","reported_seq":957,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:13.960604+0000","last_change":"2024-09-16T07:50:44.077725+0000","last_active":"2024-09-16T07:52:13.960604+0000","last_peered":"2024-09-16T07:52:13.960604+0000","last_clean":"2024-09-16T07:52:13.960604+0000","last_became_active":"2024-09-16T07:50:44.070827+0000","last_became_peered":"2024-09-16T07:50:44.070827+0000","last_unstale":"2024-09-16T07:52:13.960604+0000","last_undegraded":"2024-09-16T07:52:13.960604+0000","last_fullsized":"2024-09-16T07:52:13.960604+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":192,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.323829+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:47.323829+0000","last_peered":"2024-09-16T07:51:47.323829+0000","last_clean":"2024-09-16T07:51:47.323829+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:47.323829+0000","last_undegraded":"2024-09-16T07:51:47.323829+0000","last_fullsized":"2024-09-16T07:51:47.323829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"72'768","reported_seq":813,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:12.264641+0000","last_change":"2024-09-16T07:50:44.113078+0000","last_active":"2024-09-16T07:52:12.264641+0000","last_peered":"2024-09-16T07:52:12.264641+0000","last_clean":"2024-09-16T07:52:12.264641+0000","last_became_active":"2024-09-16T07:50:44.107968+0000","last_became_peered":"2024-09-16T07:50:44.107968+0000","last_unstale":"2024-09-16T07:52:12.264641+0000","last_undegraded":"2024-09-16T07:52:12.264641+0000","last_fullsized":"2024-09-16T07:52:12.264641+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":768,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.324534+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:47.324534+0000","last_peered":"2024-09-16T07:51:47.324534+0000","last_clean":"2024-09-16T07:51:47.324534+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:47.324534+0000","last_undegraded":"2024-09-16T07:51:47.324534+0000","last_fullsized":"2024-09-16T07:51:47.324534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"72'1072","reported_seq":1117,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.533937+0000","last_change":"2024-09-16T07:50:44.086804+0000","last_active":"2024-09-16T07:52:14.533937+0000","last_peered":"2024-09-16T07:52:14.533937+0000","last_clean":"2024-09-16T07:52:14.533937+0000","last_became_active":"2024-09-16T07:50:44.074662+0000","last_became_peered":"2024-09-16T07:50:44.074662+0000","last_unstale":"2024-09-16T07:52:14.533937+0000","last_undegraded":"2024-09-16T07:52:14.533937+0000","last_fullsized":"2024-09-16T07:52:14.533937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.323499+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:47.323499+0000","last_peered":"2024-09-16T07:51:47.323499+0000","last_clean":"2024-09-16T07:51:47.323499+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:47.323499+0000","last_undegraded":"2024-09-16T07:51:47.323499+0000","last_fullsized":"2024-09-16T07:51:47.323499+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.d","version":"72'912","reported_seq":957,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.234443+0000","last_change":"2024-09-16T07:50:44.057244+0000","last_active":"2024-09-16T07:52:14.234443+0000","last_peered":"2024-09-16T07:52:14.234443+0000","last_clean":"2024-09-16T07:52:14.234443+0000","last_became_active":"2024-09-16T07:50:44.051223+0000","last_became_peered":"2024-09-16T07:50:44.051223+0000","last_unstale":"2024-09-16T07:52:14.234443+0000","last_undegraded":"2024-09-16T07:52:14.234443+0000","last_fullsized":"2024-09-16T07:52:14.234443+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.321412+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:47.321412+0000","last_peered":"2024-09-16T07:51:47.321412+0000","last_clean":"2024-09-16T07:51:47.321412+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:47.321412+0000","last_undegraded":"2024-09-16T07:51:47.321412+0000","last_fullsized":"2024-09-16T07:51:47.321412+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"72'1072","reported_seq":1117,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:52:14.401369+0000","last_change":"2024-09-16T07:50:44.049867+0000","last_active":"2024-09-16T07:52:14.401369+0000","last_peered":"2024-09-16T07:52:14.401369+0000","last_clean":"2024-09-16T07:52:14.401369+0000","last_became_active":"2024-09-16T07:50:44.043254+0000","last_became_peered":"2024-09-16T07:50:44.043254+0000","last_unstale":"2024-09-16T07:52:14.401369+0000","last_undegraded":"2024-09-16T07:52:14.401369+0000","last_fullsized":"2024-09-16T07:52:14.401369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:50:42.890635+0000","last_clean_scrub_stamp":"2024-09-16T07:50:42.890635+0000","objects_scrubbed":0,"log_size":1072,"log_dups_size":0,"ondisk_log_size":1072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1072,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.315048+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:47.315048+0000","last_peered":"2024-09-16T07:51:47.315048+0000","last_clean":"2024-09-16T07:51:47.315048+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:47.315048+0000","last_undegraded":"2024-09-16T07:51:47.315048+0000","last_fullsized":"2024-09-16T07:51:47.315048+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":16,"stat_sum":{"num_bytes":118054912,"num_objects":1802,"num_object_clones":0,"num_object_copies":5406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14411,"num_write_kb":115288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177070080,"data_stored":354140160,"data_compressed":18282957,"data_compressed_allocated":177070080,"data_compressed_original":354140160,"omap_allocated":0,"internal_metadata":0},"log_size":14411,"ondisk_log_size":14411,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":162656,"kb_used_data":33104,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94209184,"statfs":{"total":96636764160,"available":96470204416,"internally_reserved":0,"allocated":33898496,"data_stored":66779980,"data_compressed":3435777,"data_compressed_allocated":33275904,"data_compressed_original":66551808,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171500,"kb_used_data":54424,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94200340,"statfs":{"total":96636764160,"available":96461148160,"internally_reserved":0,"allocated":55730176,"data_stored":110910828,"data_compressed":5713679,"data_compressed_allocated":55087104,"data_compressed_original":110665728,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165336,"kb_used_data":39944,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94206504,"statfs":{"total":96636764160,"available":96467460096,"internally_reserved":0,"allocated":40902656,"data_stored":81255788,"data_compressed":4182732,"data_compressed_allocated":40259584,"data_compressed_original":81010688,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172240,"kb_used_data":46848,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94199600,"statfs":{"total":96636764160,"available":96460390400,"internally_reserved":0,"allocated":47972352,"data_stored":95403353,"data_compressed":4913134,"data_compressed_allocated":47333376,"data_compressed_original":95158272,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47783936,"data_stored":95567872,"data_compressed":4933857,"data_compressed_allocated":47783936,"data_compressed_original":95567872,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40476672,"data_stored":80953344,"data_compressed":4179344,"data_compressed_allocated":40476672,"data_compressed_original":80953344,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55287808,"data_stored":110575616,"data_compressed":5708599,"data_compressed_allocated":55287808,"data_compressed_original":110575616,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33521664,"data_stored":67043328,"data_compressed":3461157,"data_compressed_allocated":33521664,"data_compressed_original":67043328,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:25.266 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:25.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:25.421+0000 7f2d62711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:25.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:25.432+0000 7f2d62711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:26.389 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Removed 1808 objects 2024-09-16T07:52:26.390 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Clean up completed and total clean up time :10.3671 2024-09-16T07:52:28.019 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:28.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:28.153+0000 7f458c711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:28.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:28.158+0000 7f458c711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:28.643 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_6 2024-09-16T07:52:28.643 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_6 unique_pool_6 --yes-i-really-really-mean-it 2024-09-16T07:52:28.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:28.751+0000 7f8e00711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:28.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:28.763+0000 7f8e00711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:29.344 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_6' removed 2024-09-16T07:52:29.365 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-16T07:52:29.366 INFO:tasks.radosbench:Beginning radosbench... 2024-09-16T07:52:29.367 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_7 2024-09-16T07:52:29.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_7 16 2024-09-16T07:52:29.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:29.522+0000 7fb733791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:29.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:29.541+0000 7fb733791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:29.898 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:29.898 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:29.898 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:30.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:30.003+0000 7f8140751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:30.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:30.010+0000 7f8140751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:30.194 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:52:30.194 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:52:30.206 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":448,"stamp":"2024-09-16T07:52:29.846149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":671732,"kb_used_data":174320,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376815628,"statfs":{"total":386547056640,"available":385859203072,"internally_reserved":0,"allocated":178503680,"data_stored":354349949,"data_compressed":18245322,"data_compressed_allocated":175955968,"data_compressed_original":353386496,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-118054912,"num_objects":-1802,"num_object_clones":0,"num_object_copies":-5406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-14411,"num_write_kb":-115288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001858"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.319172+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:47.319172+0000","last_peered":"2024-09-16T07:51:47.319172+0000","last_clean":"2024-09-16T07:51:47.319172+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:47.319172+0000","last_undegraded":"2024-09-16T07:51:47.319172+0000","last_fullsized":"2024-09-16T07:51:47.319172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":191,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.321991+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:47.321991+0000","last_peered":"2024-09-16T07:51:47.321991+0000","last_clean":"2024-09-16T07:51:47.321991+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:47.321991+0000","last_undegraded":"2024-09-16T07:51:47.321991+0000","last_fullsized":"2024-09-16T07:51:47.321991+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.319366+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:47.319366+0000","last_peered":"2024-09-16T07:51:47.319366+0000","last_clean":"2024-09-16T07:51:47.319366+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:47.319366+0000","last_undegraded":"2024-09-16T07:51:47.319366+0000","last_fullsized":"2024-09-16T07:51:47.319366+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.353414+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:47.353414+0000","last_peered":"2024-09-16T07:51:47.353414+0000","last_clean":"2024-09-16T07:51:47.353414+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:47.353414+0000","last_undegraded":"2024-09-16T07:51:47.353414+0000","last_fullsized":"2024-09-16T07:51:47.353414+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":192,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.323829+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:47.323829+0000","last_peered":"2024-09-16T07:51:47.323829+0000","last_clean":"2024-09-16T07:51:47.323829+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:47.323829+0000","last_undegraded":"2024-09-16T07:51:47.323829+0000","last_fullsized":"2024-09-16T07:51:47.323829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.324534+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:47.324534+0000","last_peered":"2024-09-16T07:51:47.324534+0000","last_clean":"2024-09-16T07:51:47.324534+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:47.324534+0000","last_undegraded":"2024-09-16T07:51:47.324534+0000","last_fullsized":"2024-09-16T07:51:47.324534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.323499+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:47.323499+0000","last_peered":"2024-09-16T07:51:47.323499+0000","last_clean":"2024-09-16T07:51:47.323499+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:47.323499+0000","last_undegraded":"2024-09-16T07:51:47.323499+0000","last_fullsized":"2024-09-16T07:51:47.323499+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.321412+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:47.321412+0000","last_peered":"2024-09-16T07:51:47.321412+0000","last_clean":"2024-09-16T07:51:47.321412+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:47.321412+0000","last_undegraded":"2024-09-16T07:51:47.321412+0000","last_fullsized":"2024-09-16T07:51:47.321412+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.315048+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:47.315048+0000","last_peered":"2024-09-16T07:51:47.315048+0000","last_clean":"2024-09-16T07:51:47.315048+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:47.315048+0000","last_undegraded":"2024-09-16T07:51:47.315048+0000","last_fullsized":"2024-09-16T07:51:47.315048+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":162656,"kb_used_data":33104,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94209184,"statfs":{"total":96636764160,"available":96470204416,"internally_reserved":0,"allocated":33898496,"data_stored":66779980,"data_compressed":3435777,"data_compressed_allocated":33275904,"data_compressed_original":66551808,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171500,"kb_used_data":54424,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94200340,"statfs":{"total":96636764160,"available":96461148160,"internally_reserved":0,"allocated":55730176,"data_stored":110910828,"data_compressed":5713679,"data_compressed_allocated":55087104,"data_compressed_original":110665728,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165336,"kb_used_data":39944,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94206504,"statfs":{"total":96636764160,"available":96467460096,"internally_reserved":0,"allocated":40902656,"data_stored":81255788,"data_compressed":4182732,"data_compressed_allocated":40259584,"data_compressed_original":81010688,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172240,"kb_used_data":46848,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94199600,"statfs":{"total":96636764160,"available":96460390400,"internally_reserved":0,"allocated":47972352,"data_stored":95403353,"data_compressed":4913134,"data_compressed_allocated":47333376,"data_compressed_original":95158272,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:30.259 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_7' created 2024-09-16T07:52:30.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:30.367+0000 7f82bef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:30.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:30.375+0000 7f82bef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:30.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_7 rados --yes-i-really-mean-it || true 2024-09-16T07:52:30.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:30.511+0000 7f0a93991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:30.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:30.526+0000 7f0a93991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:31.369 INFO:teuthology.orchestra.run.smithi137.stderr:enabled application 'rados' on pool 'unique_pool_7' 2024-09-16T07:52:32.390 DEBUG:teuthology.orchestra.run.smithi137:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 8192 --object-size 65536 -p unique_pool_7 bench 90 write' 2024-09-16T07:52:32.393 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-16T07:52:32.393 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-16T07:52:32.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:hints = 1 2024-09-16T07:52:32.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Maintaining 16 concurrent writes of 8192 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-16T07:52:32.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object prefix: benchmark_data_smithi137_61438 2024-09-16T07:52:32.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:52:32.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 0 0 0 0 0 0 - 0 2024-09-16T07:52:32.552 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:32.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:32.685+0000 7faad14fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:32.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:32.692+0000 7faad14fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:33.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 1 16 174 158 1.23431 1.23438 0.0907604 0.0951667 2024-09-16T07:52:34.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 2 16 338 322 1.25773 1.28125 0.0620735 0.0972164 2024-09-16T07:52:35.096 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:35.208 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:35.208 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:35.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:35.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:35.247+0000 7f9490191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:35.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:35.257+0000 7f9490191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:35.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:35.338+0000 7f3863e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:35.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:35.347+0000 7f3863e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:35.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 3 16 512 496 1.29157 1.35938 0.0551601 0.0945157 2024-09-16T07:52:35.583 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:52:35.584 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:52:35.596 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":453,"stamp":"2024-09-16T07:52:33.847034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":671732,"kb_used_data":174320,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376815628,"statfs":{"total":386547056640,"available":385859203072,"internally_reserved":0,"allocated":178503680,"data_stored":354349949,"data_compressed":18245322,"data_compressed_allocated":175955968,"data_compressed_original":353386496,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.497860"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.319172+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:47.319172+0000","last_peered":"2024-09-16T07:51:47.319172+0000","last_clean":"2024-09-16T07:51:47.319172+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:47.319172+0000","last_undegraded":"2024-09-16T07:51:47.319172+0000","last_fullsized":"2024-09-16T07:51:47.319172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":191,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.321991+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:47.321991+0000","last_peered":"2024-09-16T07:51:47.321991+0000","last_clean":"2024-09-16T07:51:47.321991+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:47.321991+0000","last_undegraded":"2024-09-16T07:51:47.321991+0000","last_fullsized":"2024-09-16T07:51:47.321991+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.319366+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:47.319366+0000","last_peered":"2024-09-16T07:51:47.319366+0000","last_clean":"2024-09-16T07:51:47.319366+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:47.319366+0000","last_undegraded":"2024-09-16T07:51:47.319366+0000","last_fullsized":"2024-09-16T07:51:47.319366+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.353414+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:47.353414+0000","last_peered":"2024-09-16T07:51:47.353414+0000","last_clean":"2024-09-16T07:51:47.353414+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:47.353414+0000","last_undegraded":"2024-09-16T07:51:47.353414+0000","last_fullsized":"2024-09-16T07:51:47.353414+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":192,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.323829+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:47.323829+0000","last_peered":"2024-09-16T07:51:47.323829+0000","last_clean":"2024-09-16T07:51:47.323829+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:47.323829+0000","last_undegraded":"2024-09-16T07:51:47.323829+0000","last_fullsized":"2024-09-16T07:51:47.323829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.324534+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:47.324534+0000","last_peered":"2024-09-16T07:51:47.324534+0000","last_clean":"2024-09-16T07:51:47.324534+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:47.324534+0000","last_undegraded":"2024-09-16T07:51:47.324534+0000","last_fullsized":"2024-09-16T07:51:47.324534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.323499+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:47.323499+0000","last_peered":"2024-09-16T07:51:47.323499+0000","last_clean":"2024-09-16T07:51:47.323499+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:47.323499+0000","last_undegraded":"2024-09-16T07:51:47.323499+0000","last_fullsized":"2024-09-16T07:51:47.323499+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.321412+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:47.321412+0000","last_peered":"2024-09-16T07:51:47.321412+0000","last_clean":"2024-09-16T07:51:47.321412+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:47.321412+0000","last_undegraded":"2024-09-16T07:51:47.321412+0000","last_fullsized":"2024-09-16T07:51:47.321412+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.315048+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:47.315048+0000","last_peered":"2024-09-16T07:51:47.315048+0000","last_clean":"2024-09-16T07:51:47.315048+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:47.315048+0000","last_undegraded":"2024-09-16T07:51:47.315048+0000","last_fullsized":"2024-09-16T07:51:47.315048+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":162656,"kb_used_data":33104,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94209184,"statfs":{"total":96636764160,"available":96470204416,"internally_reserved":0,"allocated":33898496,"data_stored":66779980,"data_compressed":3435777,"data_compressed_allocated":33275904,"data_compressed_original":66551808,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171500,"kb_used_data":54424,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94200340,"statfs":{"total":96636764160,"available":96461148160,"internally_reserved":0,"allocated":55730176,"data_stored":110910828,"data_compressed":5713679,"data_compressed_allocated":55087104,"data_compressed_original":110665728,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165336,"kb_used_data":39944,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94206504,"statfs":{"total":96636764160,"available":96467460096,"internally_reserved":0,"allocated":40902656,"data_stored":81255788,"data_compressed":4182732,"data_compressed_allocated":40259584,"data_compressed_original":81010688,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172240,"kb_used_data":46848,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94199600,"statfs":{"total":96636764160,"available":96460390400,"internally_reserved":0,"allocated":47972352,"data_stored":95403353,"data_compressed":4913134,"data_compressed_allocated":47333376,"data_compressed_original":95158272,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:36.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 4 16 688 672 1.3124 1.375 0.117244 0.0932044 2024-09-16T07:52:37.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 5 16 857 841 1.31396 1.32031 0.108142 0.0936519 2024-09-16T07:52:37.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:37.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:37.777+0000 7f5a3cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:37.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:37.785+0000 7f5a3cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:38.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 6 16 1043 1027 1.33713 1.45312 0.0490972 0.0927543 2024-09-16T07:52:39.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 7 16 1212 1196 1.33471 1.32031 0.134405 0.0926195 2024-09-16T07:52:40.012 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:40.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:40.163+0000 7f189565a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:40.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:40.171+0000 7f189565a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:40.457 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 8 16 1376 1360 1.32801 1.28125 0.0592425 0.0937695 2024-09-16T07:52:40.598 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:40.598 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:40.599 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:40.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:40.747+0000 7f985165c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:40.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:40.758+0000 7f985165c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:40.987 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:52:40.987 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:52:41.004 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2024-09-16T07:52:39.848148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":671732,"kb_used_data":174320,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376815628,"statfs":{"total":386547056640,"available":385859203072,"internally_reserved":0,"allocated":178503680,"data_stored":354349949,"data_compressed":18245322,"data_compressed_allocated":175955968,"data_compressed_original":353386496,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.474065"},"pg_stats":[{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":259,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.319172+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:51:47.319172+0000","last_peered":"2024-09-16T07:51:47.319172+0000","last_clean":"2024-09-16T07:51:47.319172+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:51:47.319172+0000","last_undegraded":"2024-09-16T07:51:47.319172+0000","last_fullsized":"2024-09-16T07:51:47.319172+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":191,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.321991+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:51:47.321991+0000","last_peered":"2024-09-16T07:51:47.321991+0000","last_clean":"2024-09-16T07:51:47.321991+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:51:47.321991+0000","last_undegraded":"2024-09-16T07:51:47.321991+0000","last_fullsized":"2024-09-16T07:51:47.321991+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.319366+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:51:47.319366+0000","last_peered":"2024-09-16T07:51:47.319366+0000","last_clean":"2024-09-16T07:51:47.319366+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:51:47.319366+0000","last_undegraded":"2024-09-16T07:51:47.319366+0000","last_fullsized":"2024-09-16T07:51:47.319366+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.353414+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:51:47.353414+0000","last_peered":"2024-09-16T07:51:47.353414+0000","last_clean":"2024-09-16T07:51:47.353414+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:51:47.353414+0000","last_undegraded":"2024-09-16T07:51:47.353414+0000","last_fullsized":"2024-09-16T07:51:47.353414+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":192,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.323829+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:51:47.323829+0000","last_peered":"2024-09-16T07:51:47.323829+0000","last_clean":"2024-09-16T07:51:47.323829+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:51:47.323829+0000","last_undegraded":"2024-09-16T07:51:47.323829+0000","last_fullsized":"2024-09-16T07:51:47.323829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.324534+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:51:47.324534+0000","last_peered":"2024-09-16T07:51:47.324534+0000","last_clean":"2024-09-16T07:51:47.324534+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:51:47.324534+0000","last_undegraded":"2024-09-16T07:51:47.324534+0000","last_fullsized":"2024-09-16T07:51:47.324534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.323499+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:51:47.323499+0000","last_peered":"2024-09-16T07:51:47.323499+0000","last_clean":"2024-09-16T07:51:47.323499+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:51:47.323499+0000","last_undegraded":"2024-09-16T07:51:47.323499+0000","last_fullsized":"2024-09-16T07:51:47.323499+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.321412+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:51:47.321412+0000","last_peered":"2024-09-16T07:51:47.321412+0000","last_clean":"2024-09-16T07:51:47.321412+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:51:47.321412+0000","last_undegraded":"2024-09-16T07:51:47.321412+0000","last_fullsized":"2024-09-16T07:51:47.321412+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T07:52:30.354840+0000","last_change":"2024-09-16T07:52:30.354840+0000","last_active":"2024-09-16T07:52:30.354840+0000","last_peered":"2024-09-16T07:52:30.354840+0000","last_clean":"2024-09-16T07:52:30.354840+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T07:52:30.354840+0000","last_undegraded":"2024-09-16T07:52:30.354840+0000","last_fullsized":"2024-09-16T07:52:30.354840+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":190,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-09-16T07:51:47.315048+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:51:47.315048+0000","last_peered":"2024-09-16T07:51:47.315048+0000","last_clean":"2024-09-16T07:51:47.315048+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:51:47.315048+0000","last_undegraded":"2024-09-16T07:51:47.315048+0000","last_fullsized":"2024-09-16T07:51:47.315048+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":162656,"kb_used_data":33104,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94209184,"statfs":{"total":96636764160,"available":96470204416,"internally_reserved":0,"allocated":33898496,"data_stored":66779980,"data_compressed":3435777,"data_compressed_allocated":33275904,"data_compressed_original":66551808,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171500,"kb_used_data":54424,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94200340,"statfs":{"total":96636764160,"available":96461148160,"internally_reserved":0,"allocated":55730176,"data_stored":110910828,"data_compressed":5713679,"data_compressed_allocated":55087104,"data_compressed_original":110665728,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165336,"kb_used_data":39944,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94206504,"statfs":{"total":96636764160,"available":96467460096,"internally_reserved":0,"allocated":40902656,"data_stored":81255788,"data_compressed":4182732,"data_compressed_allocated":40259584,"data_compressed_original":81010688,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":172240,"kb_used_data":46848,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94199600,"statfs":{"total":96636764160,"available":96460390400,"internally_reserved":0,"allocated":47972352,"data_stored":95403353,"data_compressed":4913134,"data_compressed_allocated":47333376,"data_compressed_original":95158272,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:41.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 9 16 1555 1539 1.33582 1.39844 0.0436991 0.0930408 2024-09-16T07:52:42.380 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:42.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 10 16 1738 1722 1.3452 1.42969 0.0770935 0.0925236 2024-09-16T07:52:42.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:42.527+0000 7f0ba7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:42.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:42.534+0000 7f0ba7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:43.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 11 16 1922 1906 1.35357 1.4375 0.0702264 0.0921671 2024-09-16T07:52:44.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 12 16 2086 2070 1.34754 1.28125 0.083962 0.0923953 2024-09-16T07:52:44.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:44.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:44.913+0000 7f5c94d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:44.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:44.921+0000 7f5c94d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:45.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 13 16 2239 2223 1.33582 1.19531 0.0402692 0.0934319 2024-09-16T07:52:46.006 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:46.007 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:46.007 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:52:46.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:52:46.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:46.143+0000 7f8de0948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:46.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:46.156+0000 7f8de0948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:46.174 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:46.179 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:46.179 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:46.180 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:52:46.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:46.303+0000 7f62b3ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:46.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:46.315+0000 7f62b3ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:46.367 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:46.368 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:46.369 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:46.369 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:46.372 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:46.372 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:46.373 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:52:46.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 14 16 2410 2394 1.33582 1.33594 0.0936429 0.0932157 2024-09-16T07:52:46.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:46.534+0000 7f2735311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:46.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:46.546+0000 7f2735311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:46.569 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:46.569 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:46.569 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:46.569 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:46.569 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:46.569 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:46.569 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:46.569 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:46.570 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:46.570 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:46.570 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:46.570 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:46.573 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:46.573 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:46.573 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:52:46.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:46.725+0000 7f0523d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:46.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:46.737+0000 7f0523d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:46.844 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:46.848 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:46.849 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:47.272 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:47.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:47.410+0000 7f7e8c8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:47.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:47.417+0000 7f7e8c8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:47.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 15 16 2573 2557 1.33166 1.27344 0.101704 0.0933432 2024-09-16T07:52:48.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 16 16 2737 2721 1.3285 1.28125 0.119258 0.0935919 2024-09-16T07:52:49.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 17 16 2912 2896 1.33077 1.36719 0.0848718 0.0936525 2024-09-16T07:52:49.651 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:49.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:49.792+0000 7f703fcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:49.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:49.798+0000 7f703fcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:50.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 18 16 3083 3067 1.33105 1.33594 0.07303 0.0935913 2024-09-16T07:52:51.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 19 16 3257 3241 1.33253 1.35938 0.116502 0.0934733 2024-09-16T07:52:51.850 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:51.850 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:51.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:52:51.984 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:52.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:51.999+0000 7f4ab9d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:52.017+0000 7f4ab9d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:52.124+0000 7fef64191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:52.133+0000 7fef64191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:52.321 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:52:52.321 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:52:52.337 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":462,"stamp":"2024-09-16T07:52:51.850369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18055731,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2213,"num_write_kb":18164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2187,"ondisk_log_size":2187,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":343092,"kb_used_data":26868,"kb_used_omap":0,"kb_used_meta":316160,"kb_avail":377144268,"statfs":{"total":386547056640,"available":386195730432,"internally_reserved":0,"allocated":27512832,"data_stored":52129769,"data_compressed":2637048,"data_compressed_allocated":24817664,"data_compressed_original":51109888,"omap_allocated":0,"internal_metadata":323747840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17465344,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2132,"num_write_kb":17056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002220"},"pg_stats":[{"pgid":"10.7","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.718531+0000","last_change":"2024-09-16T07:52:31.529234+0000","last_active":"2024-09-16T07:52:44.718531+0000","last_peered":"2024-09-16T07:52:44.718531+0000","last_clean":"2024-09-16T07:52:44.718531+0000","last_became_active":"2024-09-16T07:52:31.522933+0000","last_became_peered":"2024-09-16T07:52:31.522933+0000","last_unstale":"2024-09-16T07:52:44.718531+0000","last_undegraded":"2024-09-16T07:52:44.718531+0000","last_fullsized":"2024-09-16T07:52:44.718531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.6","version":"76'96","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.632563+0000","last_change":"2024-09-16T07:52:31.536407+0000","last_active":"2024-09-16T07:52:44.632563+0000","last_peered":"2024-09-16T07:52:44.632563+0000","last_clean":"2024-09-16T07:52:44.632563+0000","last_became_active":"2024-09-16T07:52:31.524816+0000","last_became_peered":"2024-09-16T07:52:31.524816+0000","last_unstale":"2024-09-16T07:52:44.632563+0000","last_undegraded":"2024-09-16T07:52:44.632563+0000","last_fullsized":"2024-09-16T07:52:44.632563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"76'88","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.479692+0000","last_change":"2024-09-16T07:52:31.564841+0000","last_active":"2024-09-16T07:52:43.479692+0000","last_peered":"2024-09-16T07:52:43.479692+0000","last_clean":"2024-09-16T07:52:43.479692+0000","last_became_active":"2024-09-16T07:52:31.557270+0000","last_became_peered":"2024-09-16T07:52:31.557270+0000","last_unstale":"2024-09-16T07:52:43.479692+0000","last_undegraded":"2024-09-16T07:52:43.479692+0000","last_fullsized":"2024-09-16T07:52:43.479692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.228444+0000","last_change":"2024-09-16T07:52:31.530991+0000","last_active":"2024-09-16T07:52:44.228444+0000","last_peered":"2024-09-16T07:52:44.228444+0000","last_clean":"2024-09-16T07:52:44.228444+0000","last_became_active":"2024-09-16T07:52:31.518106+0000","last_became_peered":"2024-09-16T07:52:31.518106+0000","last_unstale":"2024-09-16T07:52:44.228444+0000","last_undegraded":"2024-09-16T07:52:44.228444+0000","last_fullsized":"2024-09-16T07:52:44.228444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.586127+0000","last_change":"2024-09-16T07:52:31.575541+0000","last_active":"2024-09-16T07:52:44.586127+0000","last_peered":"2024-09-16T07:52:44.586127+0000","last_clean":"2024-09-16T07:52:44.586127+0000","last_became_active":"2024-09-16T07:52:31.557936+0000","last_became_peered":"2024-09-16T07:52:31.557936+0000","last_unstale":"2024-09-16T07:52:44.586127+0000","last_undegraded":"2024-09-16T07:52:44.586127+0000","last_fullsized":"2024-09-16T07:52:44.586127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.211296+0000","last_change":"2024-09-16T07:52:31.529903+0000","last_active":"2024-09-16T07:52:43.211296+0000","last_peered":"2024-09-16T07:52:43.211296+0000","last_clean":"2024-09-16T07:52:43.211296+0000","last_became_active":"2024-09-16T07:52:31.488561+0000","last_became_peered":"2024-09-16T07:52:31.488561+0000","last_unstale":"2024-09-16T07:52:43.211296+0000","last_undegraded":"2024-09-16T07:52:43.211296+0000","last_fullsized":"2024-09-16T07:52:43.211296+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.447795+0000","last_change":"2024-09-16T07:52:31.564066+0000","last_active":"2024-09-16T07:52:44.447795+0000","last_peered":"2024-09-16T07:52:44.447795+0000","last_clean":"2024-09-16T07:52:44.447795+0000","last_became_active":"2024-09-16T07:52:31.553855+0000","last_became_peered":"2024-09-16T07:52:31.553855+0000","last_unstale":"2024-09-16T07:52:44.447795+0000","last_undegraded":"2024-09-16T07:52:44.447795+0000","last_fullsized":"2024-09-16T07:52:44.447795+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"76'120","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.763925+0000","last_change":"2024-09-16T07:52:31.533468+0000","last_active":"2024-09-16T07:52:44.763925+0000","last_peered":"2024-09-16T07:52:44.763925+0000","last_clean":"2024-09-16T07:52:44.763925+0000","last_became_active":"2024-09-16T07:52:31.519514+0000","last_became_peered":"2024-09-16T07:52:31.519514+0000","last_unstale":"2024-09-16T07:52:44.763925+0000","last_undegraded":"2024-09-16T07:52:44.763925+0000","last_fullsized":"2024-09-16T07:52:44.763925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"76'152","reported_seq":164,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.522440+0000","last_change":"2024-09-16T07:52:31.582944+0000","last_active":"2024-09-16T07:52:44.522440+0000","last_peered":"2024-09-16T07:52:44.522440+0000","last_clean":"2024-09-16T07:52:44.522440+0000","last_became_active":"2024-09-16T07:52:31.569089+0000","last_became_peered":"2024-09-16T07:52:31.569089+0000","last_unstale":"2024-09-16T07:52:44.522440+0000","last_undegraded":"2024-09-16T07:52:44.522440+0000","last_fullsized":"2024-09-16T07:52:44.522440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.326289+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:52:32.326289+0000","last_peered":"2024-09-16T07:52:32.326289+0000","last_clean":"2024-09-16T07:52:32.326289+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:52:32.326289+0000","last_undegraded":"2024-09-16T07:52:32.326289+0000","last_fullsized":"2024-09-16T07:52:32.326289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332443+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:52:32.332443+0000","last_peered":"2024-09-16T07:52:32.332443+0000","last_clean":"2024-09-16T07:52:32.332443+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:52:32.332443+0000","last_undegraded":"2024-09-16T07:52:32.332443+0000","last_fullsized":"2024-09-16T07:52:32.332443+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"76'176","reported_seq":188,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.263174+0000","last_change":"2024-09-16T07:52:31.525007+0000","last_active":"2024-09-16T07:52:44.263174+0000","last_peered":"2024-09-16T07:52:44.263174+0000","last_clean":"2024-09-16T07:52:44.263174+0000","last_became_active":"2024-09-16T07:52:31.504171+0000","last_became_peered":"2024-09-16T07:52:31.504171+0000","last_unstale":"2024-09-16T07:52:44.263174+0000","last_undegraded":"2024-09-16T07:52:44.263174+0000","last_fullsized":"2024-09-16T07:52:44.263174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.324714+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:52:32.324714+0000","last_peered":"2024-09-16T07:52:32.324714+0000","last_clean":"2024-09-16T07:52:32.324714+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:52:32.324714+0000","last_undegraded":"2024-09-16T07:52:32.324714+0000","last_fullsized":"2024-09-16T07:52:32.324714+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"76'80","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.369630+0000","last_change":"2024-09-16T07:52:31.555379+0000","last_active":"2024-09-16T07:52:44.369630+0000","last_peered":"2024-09-16T07:52:44.369630+0000","last_clean":"2024-09-16T07:52:44.369630+0000","last_became_active":"2024-09-16T07:52:31.542828+0000","last_became_peered":"2024-09-16T07:52:31.542828+0000","last_unstale":"2024-09-16T07:52:44.369630+0000","last_undegraded":"2024-09-16T07:52:44.369630+0000","last_fullsized":"2024-09-16T07:52:44.369630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.336378+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:52:32.336378+0000","last_peered":"2024-09-16T07:52:32.336378+0000","last_clean":"2024-09-16T07:52:32.336378+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:52:32.336378+0000","last_undegraded":"2024-09-16T07:52:32.336378+0000","last_fullsized":"2024-09-16T07:52:32.336378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"76'136","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.068487+0000","last_change":"2024-09-16T07:52:31.625673+0000","last_active":"2024-09-16T07:52:43.068487+0000","last_peered":"2024-09-16T07:52:43.068487+0000","last_clean":"2024-09-16T07:52:43.068487+0000","last_became_active":"2024-09-16T07:52:31.621163+0000","last_became_peered":"2024-09-16T07:52:31.621163+0000","last_unstale":"2024-09-16T07:52:43.068487+0000","last_undegraded":"2024-09-16T07:52:43.068487+0000","last_fullsized":"2024-09-16T07:52:43.068487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.334916+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:52:32.334916+0000","last_peered":"2024-09-16T07:52:32.334916+0000","last_clean":"2024-09-16T07:52:32.334916+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:52:32.334916+0000","last_undegraded":"2024-09-16T07:52:32.334916+0000","last_fullsized":"2024-09-16T07:52:32.334916+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.083713+0000","last_change":"2024-09-16T07:52:31.516071+0000","last_active":"2024-09-16T07:52:44.083713+0000","last_peered":"2024-09-16T07:52:44.083713+0000","last_clean":"2024-09-16T07:52:44.083713+0000","last_became_active":"2024-09-16T07:52:31.508923+0000","last_became_peered":"2024-09-16T07:52:31.508923+0000","last_unstale":"2024-09-16T07:52:44.083713+0000","last_undegraded":"2024-09-16T07:52:44.083713+0000","last_fullsized":"2024-09-16T07:52:44.083713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332525+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:52:32.332525+0000","last_peered":"2024-09-16T07:52:32.332525+0000","last_clean":"2024-09-16T07:52:32.332525+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:52:32.332525+0000","last_undegraded":"2024-09-16T07:52:32.332525+0000","last_fullsized":"2024-09-16T07:52:32.332525+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"76'120","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.336500+0000","last_change":"2024-09-16T07:52:31.593107+0000","last_active":"2024-09-16T07:52:43.336500+0000","last_peered":"2024-09-16T07:52:43.336500+0000","last_clean":"2024-09-16T07:52:43.336500+0000","last_became_active":"2024-09-16T07:52:31.587475+0000","last_became_peered":"2024-09-16T07:52:31.587475+0000","last_unstale":"2024-09-16T07:52:43.336500+0000","last_undegraded":"2024-09-16T07:52:43.336500+0000","last_fullsized":"2024-09-16T07:52:43.336500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.331320+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:52:32.331320+0000","last_peered":"2024-09-16T07:52:32.331320+0000","last_clean":"2024-09-16T07:52:32.331320+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:52:32.331320+0000","last_undegraded":"2024-09-16T07:52:32.331320+0000","last_fullsized":"2024-09-16T07:52:32.331320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.159765+0000","last_change":"2024-09-16T07:52:31.517765+0000","last_active":"2024-09-16T07:52:44.159765+0000","last_peered":"2024-09-16T07:52:44.159765+0000","last_clean":"2024-09-16T07:52:44.159765+0000","last_became_active":"2024-09-16T07:52:31.508464+0000","last_became_peered":"2024-09-16T07:52:31.508464+0000","last_unstale":"2024-09-16T07:52:44.159765+0000","last_undegraded":"2024-09-16T07:52:44.159765+0000","last_fullsized":"2024-09-16T07:52:44.159765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.325734+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:52:32.325734+0000","last_peered":"2024-09-16T07:52:32.325734+0000","last_clean":"2024-09-16T07:52:32.325734+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:52:32.325734+0000","last_undegraded":"2024-09-16T07:52:32.325734+0000","last_fullsized":"2024-09-16T07:52:32.325734+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"76'52","reported_seq":64,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.767796+0000","last_change":"2024-09-16T07:52:31.504993+0000","last_active":"2024-09-16T07:52:44.767796+0000","last_peered":"2024-09-16T07:52:44.767796+0000","last_clean":"2024-09-16T07:52:44.767796+0000","last_became_active":"2024-09-16T07:52:31.493993+0000","last_became_peered":"2024-09-16T07:52:31.493993+0000","last_unstale":"2024-09-16T07:52:44.767796+0000","last_undegraded":"2024-09-16T07:52:44.767796+0000","last_fullsized":"2024-09-16T07:52:44.767796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425984,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.327152+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:52:32.327152+0000","last_peered":"2024-09-16T07:52:32.327152+0000","last_clean":"2024-09-16T07:52:32.327152+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:52:32.327152+0000","last_undegraded":"2024-09-16T07:52:32.327152+0000","last_fullsized":"2024-09-16T07:52:32.327152+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":17465344,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2132,"num_write_kb":17056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26157056,"data_stored":52314112,"data_compressed":2697948,"data_compressed_allocated":26157056,"data_compressed_original":52314112,"omap_allocated":0,"internal_metadata":0},"log_size":2132,"ondisk_log_size":2132,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131940,"kb_used_data":6548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94239900,"statfs":{"total":96636764160,"available":96501657600,"internally_reserved":0,"allocated":6705152,"data_stored":12333671,"data_compressed":623532,"data_compressed_allocated":6045696,"data_compressed_original":12091392,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49436,"kb_used_data":7820,"kb_used_omap":0,"kb_used_meta":41600,"kb_avail":94322404,"statfs":{"total":96636764160,"available":96586141696,"internally_reserved":0,"allocated":8007680,"data_stored":15406215,"data_compressed":781564,"data_compressed_allocated":7327744,"data_compressed_original":15147008,"omap_allocated":0,"internal_metadata":42598400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123400,"kb_used_data":6328,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94248440,"statfs":{"total":96636764160,"available":96510402560,"internally_reserved":0,"allocated":6479872,"data_stored":12350599,"data_compressed":624009,"data_compressed_allocated":5799936,"data_compressed_original":12091392,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":38316,"kb_used_data":6172,"kb_used_omap":0,"kb_used_meta":32128,"kb_avail":94333524,"statfs":{"total":96636764160,"available":96597528576,"internally_reserved":0,"allocated":6320128,"data_stored":12039284,"data_compressed":607943,"data_compressed_allocated":5644288,"data_compressed_original":11780096,"omap_allocated":0,"internal_metadata":32899072},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":11919360,"data_compressed":614707,"data_compressed_allocated":5959680,"data_compressed_original":11919360,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6164480,"data_stored":12328960,"data_compressed":635849,"data_compressed_allocated":6164480,"data_compressed_original":12328960,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7544832,"data_stored":15089664,"data_compressed":778176,"data_compressed_allocated":7544832,"data_compressed_original":15089664,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6488064,"data_stored":12976128,"data_compressed":669216,"data_compressed_allocated":6488064,"data_compressed_original":12976128,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:52:52.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:52:52.460478+0000 min lat: 0.0193202 max lat: 0.290033 avg lat: 0.0935284 2024-09-16T07:52:52.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:52:52.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 20 16 3431 3415 1.33387 1.35938 0.0594456 0.0935284 2024-09-16T07:52:53.458 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 21 16 3612 3596 1.33768 1.41406 0.0316282 0.0933162 2024-09-16T07:52:54.396 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:54.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 22 16 3761 3745 1.32978 1.16406 0.142233 0.0935481 2024-09-16T07:52:54.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:54.518+0000 7fd4a12ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:54.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:54.524+0000 7fd4a12ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:55.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 23 16 3939 3923 1.33242 1.39062 0.105017 0.0936154 2024-09-16T07:52:56.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 24 16 4105 4089 1.33093 1.29688 0.182023 0.093505 2024-09-16T07:52:56.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:52:56.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:56.841+0000 7f9ff5463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:56.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:56.848+0000 7f9ff5463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.338 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:52:57.339 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:52:57.339 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:52:57.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:52:57.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 25 16 4294 4278 1.33675 1.47656 0.12951 0.0932772 2024-09-16T07:52:57.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:57.473+0000 7f685ec63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:57.486+0000 7f685ec63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.520 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:57.521 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:57.525 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:57.525 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:57.526 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:52:57.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:57.678+0000 7f6c89f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:57.692+0000 7f6c89f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.714 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:57.714 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:57.714 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:57.714 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:57.714 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:57.715 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:57.715 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:57.715 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:57.715 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:57.715 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:57.715 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:57.715 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:57.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:57.719 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:57.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:52:57.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:57.866+0000 7f357af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:57.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:57.878+0000 7f357af91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:58.004 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:58.004 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:58.004 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:58.004 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:58.004 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:58.004 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:58.004 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:58.004 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:58.005 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:58.005 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:58.005 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:58.005 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:58.007 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:58.007 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:58.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:52:58.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:58.142+0000 7f139906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:58.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:58.154+0000 7f139906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:58.177 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:52:58.177 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:52:58.177 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:52:58.177 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:52:58.177 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:52:58.177 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:52:58.178 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:52:58.178 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:52:58.178 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:52:58.178 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:52:58.178 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:52:58.178 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:52:58.180 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:52:58.181 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:52:58.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 26 16 4466 4450 1.33702 1.34375 0.0788353 0.0933266 2024-09-16T07:52:59.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:52:59.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:59.208+0000 7f16e7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:52:59.214+0000 7f16e7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:52:59.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 27 16 4624 4608 1.33321 1.23438 0.157827 0.0934259 2024-09-16T07:53:00.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 28 16 4794 4778 1.33303 1.32812 0.0786138 0.0936921 2024-09-16T07:53:01.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 29 16 4975 4959 1.33582 1.41406 0.126642 0.0934499 2024-09-16T07:53:01.495 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:01.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:01.642+0000 7f13d7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:01.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:01.649+0000 7f13d7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:02.459 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 30 16 5142 5126 1.33477 1.30469 0.0477786 0.0934237 2024-09-16T07:53:03.182 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:03.278 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:03.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:03.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:03.426+0000 7f97698d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:03.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:03.439+0000 7f97698d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:03.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 31 16 5326 5310 1.33808 1.4375 0.0785675 0.0932311 2024-09-16T07:53:03.723 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:53:03.724 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:53:03.739 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2024-09-16T07:53:01.852484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18055731,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2213,"num_write_kb":18164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2187,"ondisk_log_size":2187,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":343092,"kb_used_data":26868,"kb_used_omap":0,"kb_used_meta":316160,"kb_avail":377144268,"statfs":{"total":386547056640,"available":386195730432,"internally_reserved":0,"allocated":27512832,"data_stored":52129769,"data_compressed":2637048,"data_compressed_allocated":24817664,"data_compressed_original":51109888,"omap_allocated":0,"internal_metadata":323747840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002530"},"pg_stats":[{"pgid":"10.7","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.718531+0000","last_change":"2024-09-16T07:52:31.529234+0000","last_active":"2024-09-16T07:52:44.718531+0000","last_peered":"2024-09-16T07:52:44.718531+0000","last_clean":"2024-09-16T07:52:44.718531+0000","last_became_active":"2024-09-16T07:52:31.522933+0000","last_became_peered":"2024-09-16T07:52:31.522933+0000","last_unstale":"2024-09-16T07:52:44.718531+0000","last_undegraded":"2024-09-16T07:52:44.718531+0000","last_fullsized":"2024-09-16T07:52:44.718531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.6","version":"76'96","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.632563+0000","last_change":"2024-09-16T07:52:31.536407+0000","last_active":"2024-09-16T07:52:44.632563+0000","last_peered":"2024-09-16T07:52:44.632563+0000","last_clean":"2024-09-16T07:52:44.632563+0000","last_became_active":"2024-09-16T07:52:31.524816+0000","last_became_peered":"2024-09-16T07:52:31.524816+0000","last_unstale":"2024-09-16T07:52:44.632563+0000","last_undegraded":"2024-09-16T07:52:44.632563+0000","last_fullsized":"2024-09-16T07:52:44.632563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"76'88","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.479692+0000","last_change":"2024-09-16T07:52:31.564841+0000","last_active":"2024-09-16T07:52:43.479692+0000","last_peered":"2024-09-16T07:52:43.479692+0000","last_clean":"2024-09-16T07:52:43.479692+0000","last_became_active":"2024-09-16T07:52:31.557270+0000","last_became_peered":"2024-09-16T07:52:31.557270+0000","last_unstale":"2024-09-16T07:52:43.479692+0000","last_undegraded":"2024-09-16T07:52:43.479692+0000","last_fullsized":"2024-09-16T07:52:43.479692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.228444+0000","last_change":"2024-09-16T07:52:31.530991+0000","last_active":"2024-09-16T07:52:44.228444+0000","last_peered":"2024-09-16T07:52:44.228444+0000","last_clean":"2024-09-16T07:52:44.228444+0000","last_became_active":"2024-09-16T07:52:31.518106+0000","last_became_peered":"2024-09-16T07:52:31.518106+0000","last_unstale":"2024-09-16T07:52:44.228444+0000","last_undegraded":"2024-09-16T07:52:44.228444+0000","last_fullsized":"2024-09-16T07:52:44.228444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.586127+0000","last_change":"2024-09-16T07:52:31.575541+0000","last_active":"2024-09-16T07:52:44.586127+0000","last_peered":"2024-09-16T07:52:44.586127+0000","last_clean":"2024-09-16T07:52:44.586127+0000","last_became_active":"2024-09-16T07:52:31.557936+0000","last_became_peered":"2024-09-16T07:52:31.557936+0000","last_unstale":"2024-09-16T07:52:44.586127+0000","last_undegraded":"2024-09-16T07:52:44.586127+0000","last_fullsized":"2024-09-16T07:52:44.586127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.211296+0000","last_change":"2024-09-16T07:52:31.529903+0000","last_active":"2024-09-16T07:52:43.211296+0000","last_peered":"2024-09-16T07:52:43.211296+0000","last_clean":"2024-09-16T07:52:43.211296+0000","last_became_active":"2024-09-16T07:52:31.488561+0000","last_became_peered":"2024-09-16T07:52:31.488561+0000","last_unstale":"2024-09-16T07:52:43.211296+0000","last_undegraded":"2024-09-16T07:52:43.211296+0000","last_fullsized":"2024-09-16T07:52:43.211296+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.447795+0000","last_change":"2024-09-16T07:52:31.564066+0000","last_active":"2024-09-16T07:52:44.447795+0000","last_peered":"2024-09-16T07:52:44.447795+0000","last_clean":"2024-09-16T07:52:44.447795+0000","last_became_active":"2024-09-16T07:52:31.553855+0000","last_became_peered":"2024-09-16T07:52:31.553855+0000","last_unstale":"2024-09-16T07:52:44.447795+0000","last_undegraded":"2024-09-16T07:52:44.447795+0000","last_fullsized":"2024-09-16T07:52:44.447795+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"76'120","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.763925+0000","last_change":"2024-09-16T07:52:31.533468+0000","last_active":"2024-09-16T07:52:44.763925+0000","last_peered":"2024-09-16T07:52:44.763925+0000","last_clean":"2024-09-16T07:52:44.763925+0000","last_became_active":"2024-09-16T07:52:31.519514+0000","last_became_peered":"2024-09-16T07:52:31.519514+0000","last_unstale":"2024-09-16T07:52:44.763925+0000","last_undegraded":"2024-09-16T07:52:44.763925+0000","last_fullsized":"2024-09-16T07:52:44.763925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"76'152","reported_seq":164,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.522440+0000","last_change":"2024-09-16T07:52:31.582944+0000","last_active":"2024-09-16T07:52:44.522440+0000","last_peered":"2024-09-16T07:52:44.522440+0000","last_clean":"2024-09-16T07:52:44.522440+0000","last_became_active":"2024-09-16T07:52:31.569089+0000","last_became_peered":"2024-09-16T07:52:31.569089+0000","last_unstale":"2024-09-16T07:52:44.522440+0000","last_undegraded":"2024-09-16T07:52:44.522440+0000","last_fullsized":"2024-09-16T07:52:44.522440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.326289+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:52:32.326289+0000","last_peered":"2024-09-16T07:52:32.326289+0000","last_clean":"2024-09-16T07:52:32.326289+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:52:32.326289+0000","last_undegraded":"2024-09-16T07:52:32.326289+0000","last_fullsized":"2024-09-16T07:52:32.326289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332443+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:52:32.332443+0000","last_peered":"2024-09-16T07:52:32.332443+0000","last_clean":"2024-09-16T07:52:32.332443+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:52:32.332443+0000","last_undegraded":"2024-09-16T07:52:32.332443+0000","last_fullsized":"2024-09-16T07:52:32.332443+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"76'176","reported_seq":188,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.263174+0000","last_change":"2024-09-16T07:52:31.525007+0000","last_active":"2024-09-16T07:52:44.263174+0000","last_peered":"2024-09-16T07:52:44.263174+0000","last_clean":"2024-09-16T07:52:44.263174+0000","last_became_active":"2024-09-16T07:52:31.504171+0000","last_became_peered":"2024-09-16T07:52:31.504171+0000","last_unstale":"2024-09-16T07:52:44.263174+0000","last_undegraded":"2024-09-16T07:52:44.263174+0000","last_fullsized":"2024-09-16T07:52:44.263174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.324714+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:52:32.324714+0000","last_peered":"2024-09-16T07:52:32.324714+0000","last_clean":"2024-09-16T07:52:32.324714+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:52:32.324714+0000","last_undegraded":"2024-09-16T07:52:32.324714+0000","last_fullsized":"2024-09-16T07:52:32.324714+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"76'80","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.369630+0000","last_change":"2024-09-16T07:52:31.555379+0000","last_active":"2024-09-16T07:52:44.369630+0000","last_peered":"2024-09-16T07:52:44.369630+0000","last_clean":"2024-09-16T07:52:44.369630+0000","last_became_active":"2024-09-16T07:52:31.542828+0000","last_became_peered":"2024-09-16T07:52:31.542828+0000","last_unstale":"2024-09-16T07:52:44.369630+0000","last_undegraded":"2024-09-16T07:52:44.369630+0000","last_fullsized":"2024-09-16T07:52:44.369630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.336378+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:52:32.336378+0000","last_peered":"2024-09-16T07:52:32.336378+0000","last_clean":"2024-09-16T07:52:32.336378+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:52:32.336378+0000","last_undegraded":"2024-09-16T07:52:32.336378+0000","last_fullsized":"2024-09-16T07:52:32.336378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"76'136","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.068487+0000","last_change":"2024-09-16T07:52:31.625673+0000","last_active":"2024-09-16T07:52:43.068487+0000","last_peered":"2024-09-16T07:52:43.068487+0000","last_clean":"2024-09-16T07:52:43.068487+0000","last_became_active":"2024-09-16T07:52:31.621163+0000","last_became_peered":"2024-09-16T07:52:31.621163+0000","last_unstale":"2024-09-16T07:52:43.068487+0000","last_undegraded":"2024-09-16T07:52:43.068487+0000","last_fullsized":"2024-09-16T07:52:43.068487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.334916+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:52:32.334916+0000","last_peered":"2024-09-16T07:52:32.334916+0000","last_clean":"2024-09-16T07:52:32.334916+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:52:32.334916+0000","last_undegraded":"2024-09-16T07:52:32.334916+0000","last_fullsized":"2024-09-16T07:52:32.334916+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.083713+0000","last_change":"2024-09-16T07:52:31.516071+0000","last_active":"2024-09-16T07:52:44.083713+0000","last_peered":"2024-09-16T07:52:44.083713+0000","last_clean":"2024-09-16T07:52:44.083713+0000","last_became_active":"2024-09-16T07:52:31.508923+0000","last_became_peered":"2024-09-16T07:52:31.508923+0000","last_unstale":"2024-09-16T07:52:44.083713+0000","last_undegraded":"2024-09-16T07:52:44.083713+0000","last_fullsized":"2024-09-16T07:52:44.083713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332525+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:52:32.332525+0000","last_peered":"2024-09-16T07:52:32.332525+0000","last_clean":"2024-09-16T07:52:32.332525+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:52:32.332525+0000","last_undegraded":"2024-09-16T07:52:32.332525+0000","last_fullsized":"2024-09-16T07:52:32.332525+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"76'120","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.336500+0000","last_change":"2024-09-16T07:52:31.593107+0000","last_active":"2024-09-16T07:52:43.336500+0000","last_peered":"2024-09-16T07:52:43.336500+0000","last_clean":"2024-09-16T07:52:43.336500+0000","last_became_active":"2024-09-16T07:52:31.587475+0000","last_became_peered":"2024-09-16T07:52:31.587475+0000","last_unstale":"2024-09-16T07:52:43.336500+0000","last_undegraded":"2024-09-16T07:52:43.336500+0000","last_fullsized":"2024-09-16T07:52:43.336500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.331320+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:52:32.331320+0000","last_peered":"2024-09-16T07:52:32.331320+0000","last_clean":"2024-09-16T07:52:32.331320+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:52:32.331320+0000","last_undegraded":"2024-09-16T07:52:32.331320+0000","last_fullsized":"2024-09-16T07:52:32.331320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.159765+0000","last_change":"2024-09-16T07:52:31.517765+0000","last_active":"2024-09-16T07:52:44.159765+0000","last_peered":"2024-09-16T07:52:44.159765+0000","last_clean":"2024-09-16T07:52:44.159765+0000","last_became_active":"2024-09-16T07:52:31.508464+0000","last_became_peered":"2024-09-16T07:52:31.508464+0000","last_unstale":"2024-09-16T07:52:44.159765+0000","last_undegraded":"2024-09-16T07:52:44.159765+0000","last_fullsized":"2024-09-16T07:52:44.159765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.325734+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:52:32.325734+0000","last_peered":"2024-09-16T07:52:32.325734+0000","last_clean":"2024-09-16T07:52:32.325734+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:52:32.325734+0000","last_undegraded":"2024-09-16T07:52:32.325734+0000","last_fullsized":"2024-09-16T07:52:32.325734+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"76'52","reported_seq":64,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.767796+0000","last_change":"2024-09-16T07:52:31.504993+0000","last_active":"2024-09-16T07:52:44.767796+0000","last_peered":"2024-09-16T07:52:44.767796+0000","last_clean":"2024-09-16T07:52:44.767796+0000","last_became_active":"2024-09-16T07:52:31.493993+0000","last_became_peered":"2024-09-16T07:52:31.493993+0000","last_unstale":"2024-09-16T07:52:44.767796+0000","last_undegraded":"2024-09-16T07:52:44.767796+0000","last_fullsized":"2024-09-16T07:52:44.767796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425984,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.327152+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:52:32.327152+0000","last_peered":"2024-09-16T07:52:32.327152+0000","last_clean":"2024-09-16T07:52:32.327152+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:52:32.327152+0000","last_undegraded":"2024-09-16T07:52:32.327152+0000","last_fullsized":"2024-09-16T07:52:32.327152+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":17465344,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2132,"num_write_kb":17056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26157056,"data_stored":52314112,"data_compressed":2697948,"data_compressed_allocated":26157056,"data_compressed_original":52314112,"omap_allocated":0,"internal_metadata":0},"log_size":2132,"ondisk_log_size":2132,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131940,"kb_used_data":6548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94239900,"statfs":{"total":96636764160,"available":96501657600,"internally_reserved":0,"allocated":6705152,"data_stored":12333671,"data_compressed":623532,"data_compressed_allocated":6045696,"data_compressed_original":12091392,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49436,"kb_used_data":7820,"kb_used_omap":0,"kb_used_meta":41600,"kb_avail":94322404,"statfs":{"total":96636764160,"available":96586141696,"internally_reserved":0,"allocated":8007680,"data_stored":15406215,"data_compressed":781564,"data_compressed_allocated":7327744,"data_compressed_original":15147008,"omap_allocated":0,"internal_metadata":42598400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123400,"kb_used_data":6328,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94248440,"statfs":{"total":96636764160,"available":96510402560,"internally_reserved":0,"allocated":6479872,"data_stored":12350599,"data_compressed":624009,"data_compressed_allocated":5799936,"data_compressed_original":12091392,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":38316,"kb_used_data":6172,"kb_used_omap":0,"kb_used_meta":32128,"kb_avail":94333524,"statfs":{"total":96636764160,"available":96597528576,"internally_reserved":0,"allocated":6320128,"data_stored":12039284,"data_compressed":607943,"data_compressed_allocated":5644288,"data_compressed_original":11780096,"omap_allocated":0,"internal_metadata":32899072},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":11919360,"data_compressed":614707,"data_compressed_allocated":5959680,"data_compressed_original":11919360,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6164480,"data_stored":12328960,"data_compressed":635849,"data_compressed_allocated":6164480,"data_compressed_original":12328960,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7544832,"data_stored":15089664,"data_compressed":778176,"data_compressed_allocated":7544832,"data_compressed_original":15089664,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6488064,"data_stored":12976128,"data_compressed":669216,"data_compressed_allocated":6488064,"data_compressed_original":12976128,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:03.970 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:04.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:04.105+0000 7fc53a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:04.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:04.113+0000 7fc53a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:04.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 32 16 5465 5449 1.3302 1.08594 0.0647351 0.0937308 2024-09-16T07:53:05.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 33 16 5641 5625 1.33156 1.375 0.0950404 0.0937126 2024-09-16T07:53:06.329 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:06.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 34 16 5807 5791 1.33053 1.29688 0.0624178 0.0938151 2024-09-16T07:53:06.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:06.484+0000 7fe805991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:06.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:06.494+0000 7fe805991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:07.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 35 16 5968 5952 1.32845 1.25781 0.115339 0.0938747 2024-09-16T07:53:08.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 36 16 6139 6123 1.32866 1.33594 0.0534967 0.0939641 2024-09-16T07:53:08.742 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:08.742 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:08.742 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:53:08.743 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:53:08.759 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:08.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:08.895+0000 7fe399cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:08.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:08.908+0000 7fe399cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:08.934 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:08.934 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:08.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:08.938 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:08.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:53:08.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:08.946+0000 7f890ea74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:08.954+0000 7f890ea74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:09.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:09.098+0000 7f5c7d288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:09.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:09.115+0000 7f5c7d288640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:09.140 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:09.141 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:09.144 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:09.145 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:09.145 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:53:09.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:09.325+0000 7fe82005c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:09.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:09.336+0000 7fe82005c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:09.395 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:09.395 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:09.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:09.398 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:09.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:53:09.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 37 16 6306 6290 1.32801 1.30469 0.052519 0.0940088 2024-09-16T07:53:09.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:09.568+0000 7fdcdc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:09.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:09.584+0000 7fdcdc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:09.605 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:09.606 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:09.606 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:09.606 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:09.606 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:09.606 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:09.606 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:09.609 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:09.609 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:10.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 38 16 6484 6468 1.32965 1.39062 0.138682 0.0937972 2024-09-16T07:53:11.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:11.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:11.422+0000 7f1e5ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:11.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:11.429+0000 7f1e5ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:11.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 39 16 6660 6644 1.33081 1.375 0.100273 0.0938079 2024-09-16T07:53:12.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:53:12.462250+0000 min lat: 0.0164956 max lat: 0.290033 avg lat: 0.0939115 2024-09-16T07:53:12.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:53:12.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 40 16 6823 6807 1.32937 1.27344 0.068249 0.0939115 2024-09-16T07:53:13.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 41 16 6970 6954 1.32496 1.14844 0.0670056 0.094224 2024-09-16T07:53:13.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:14.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:14.118+0000 7f2ba5b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:14.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:14.125+0000 7f2ba5b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:14.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 42 16 7119 7103 1.32112 1.16406 0.0701577 0.0945164 2024-09-16T07:53:14.611 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:14.611 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:14.611 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:14.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:14.756+0000 7f7e58591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:14.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:14.768+0000 7f7e58591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:15.074 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:53:15.075 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:53:15.091 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":473,"stamp":"2024-09-16T07:53:13.855045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18055731,"num_objects":271,"num_object_clones":0,"num_object_copies":813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2213,"num_write_kb":18164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2187,"ondisk_log_size":2187,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":343092,"kb_used_data":26868,"kb_used_omap":0,"kb_used_meta":316160,"kb_avail":377144268,"statfs":{"total":386547056640,"available":386195730432,"internally_reserved":0,"allocated":27512832,"data_stored":52129769,"data_compressed":2637048,"data_compressed_allocated":24817664,"data_compressed_original":51109888,"omap_allocated":0,"internal_metadata":323747840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002561"},"pg_stats":[{"pgid":"10.7","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.718531+0000","last_change":"2024-09-16T07:52:31.529234+0000","last_active":"2024-09-16T07:52:44.718531+0000","last_peered":"2024-09-16T07:52:44.718531+0000","last_clean":"2024-09-16T07:52:44.718531+0000","last_became_active":"2024-09-16T07:52:31.522933+0000","last_became_peered":"2024-09-16T07:52:31.522933+0000","last_unstale":"2024-09-16T07:52:44.718531+0000","last_undegraded":"2024-09-16T07:52:44.718531+0000","last_fullsized":"2024-09-16T07:52:44.718531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.6","version":"76'96","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.632563+0000","last_change":"2024-09-16T07:52:31.536407+0000","last_active":"2024-09-16T07:52:44.632563+0000","last_peered":"2024-09-16T07:52:44.632563+0000","last_clean":"2024-09-16T07:52:44.632563+0000","last_became_active":"2024-09-16T07:52:31.524816+0000","last_became_peered":"2024-09-16T07:52:31.524816+0000","last_unstale":"2024-09-16T07:52:44.632563+0000","last_undegraded":"2024-09-16T07:52:44.632563+0000","last_fullsized":"2024-09-16T07:52:44.632563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"76'88","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.479692+0000","last_change":"2024-09-16T07:52:31.564841+0000","last_active":"2024-09-16T07:52:43.479692+0000","last_peered":"2024-09-16T07:52:43.479692+0000","last_clean":"2024-09-16T07:52:43.479692+0000","last_became_active":"2024-09-16T07:52:31.557270+0000","last_became_peered":"2024-09-16T07:52:31.557270+0000","last_unstale":"2024-09-16T07:52:43.479692+0000","last_undegraded":"2024-09-16T07:52:43.479692+0000","last_fullsized":"2024-09-16T07:52:43.479692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.228444+0000","last_change":"2024-09-16T07:52:31.530991+0000","last_active":"2024-09-16T07:52:44.228444+0000","last_peered":"2024-09-16T07:52:44.228444+0000","last_clean":"2024-09-16T07:52:44.228444+0000","last_became_active":"2024-09-16T07:52:31.518106+0000","last_became_peered":"2024-09-16T07:52:31.518106+0000","last_unstale":"2024-09-16T07:52:44.228444+0000","last_undegraded":"2024-09-16T07:52:44.228444+0000","last_fullsized":"2024-09-16T07:52:44.228444+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.586127+0000","last_change":"2024-09-16T07:52:31.575541+0000","last_active":"2024-09-16T07:52:44.586127+0000","last_peered":"2024-09-16T07:52:44.586127+0000","last_clean":"2024-09-16T07:52:44.586127+0000","last_became_active":"2024-09-16T07:52:31.557936+0000","last_became_peered":"2024-09-16T07:52:31.557936+0000","last_unstale":"2024-09-16T07:52:44.586127+0000","last_undegraded":"2024-09-16T07:52:44.586127+0000","last_fullsized":"2024-09-16T07:52:44.586127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.211296+0000","last_change":"2024-09-16T07:52:31.529903+0000","last_active":"2024-09-16T07:52:43.211296+0000","last_peered":"2024-09-16T07:52:43.211296+0000","last_clean":"2024-09-16T07:52:43.211296+0000","last_became_active":"2024-09-16T07:52:31.488561+0000","last_became_peered":"2024-09-16T07:52:31.488561+0000","last_unstale":"2024-09-16T07:52:43.211296+0000","last_undegraded":"2024-09-16T07:52:43.211296+0000","last_fullsized":"2024-09-16T07:52:43.211296+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.447795+0000","last_change":"2024-09-16T07:52:31.564066+0000","last_active":"2024-09-16T07:52:44.447795+0000","last_peered":"2024-09-16T07:52:44.447795+0000","last_clean":"2024-09-16T07:52:44.447795+0000","last_became_active":"2024-09-16T07:52:31.553855+0000","last_became_peered":"2024-09-16T07:52:31.553855+0000","last_unstale":"2024-09-16T07:52:44.447795+0000","last_undegraded":"2024-09-16T07:52:44.447795+0000","last_fullsized":"2024-09-16T07:52:44.447795+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"76'120","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.763925+0000","last_change":"2024-09-16T07:52:31.533468+0000","last_active":"2024-09-16T07:52:44.763925+0000","last_peered":"2024-09-16T07:52:44.763925+0000","last_clean":"2024-09-16T07:52:44.763925+0000","last_became_active":"2024-09-16T07:52:31.519514+0000","last_became_peered":"2024-09-16T07:52:31.519514+0000","last_unstale":"2024-09-16T07:52:44.763925+0000","last_undegraded":"2024-09-16T07:52:44.763925+0000","last_fullsized":"2024-09-16T07:52:44.763925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"76'152","reported_seq":164,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.522440+0000","last_change":"2024-09-16T07:52:31.582944+0000","last_active":"2024-09-16T07:52:44.522440+0000","last_peered":"2024-09-16T07:52:44.522440+0000","last_clean":"2024-09-16T07:52:44.522440+0000","last_became_active":"2024-09-16T07:52:31.569089+0000","last_became_peered":"2024-09-16T07:52:31.569089+0000","last_unstale":"2024-09-16T07:52:44.522440+0000","last_undegraded":"2024-09-16T07:52:44.522440+0000","last_fullsized":"2024-09-16T07:52:44.522440+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.326289+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:52:32.326289+0000","last_peered":"2024-09-16T07:52:32.326289+0000","last_clean":"2024-09-16T07:52:32.326289+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:52:32.326289+0000","last_undegraded":"2024-09-16T07:52:32.326289+0000","last_fullsized":"2024-09-16T07:52:32.326289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332443+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:52:32.332443+0000","last_peered":"2024-09-16T07:52:32.332443+0000","last_clean":"2024-09-16T07:52:32.332443+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:52:32.332443+0000","last_undegraded":"2024-09-16T07:52:32.332443+0000","last_fullsized":"2024-09-16T07:52:32.332443+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"76'176","reported_seq":188,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.263174+0000","last_change":"2024-09-16T07:52:31.525007+0000","last_active":"2024-09-16T07:52:44.263174+0000","last_peered":"2024-09-16T07:52:44.263174+0000","last_clean":"2024-09-16T07:52:44.263174+0000","last_became_active":"2024-09-16T07:52:31.504171+0000","last_became_peered":"2024-09-16T07:52:31.504171+0000","last_unstale":"2024-09-16T07:52:44.263174+0000","last_undegraded":"2024-09-16T07:52:44.263174+0000","last_fullsized":"2024-09-16T07:52:44.263174+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.324714+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:52:32.324714+0000","last_peered":"2024-09-16T07:52:32.324714+0000","last_clean":"2024-09-16T07:52:32.324714+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:52:32.324714+0000","last_undegraded":"2024-09-16T07:52:32.324714+0000","last_fullsized":"2024-09-16T07:52:32.324714+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"76'80","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.369630+0000","last_change":"2024-09-16T07:52:31.555379+0000","last_active":"2024-09-16T07:52:44.369630+0000","last_peered":"2024-09-16T07:52:44.369630+0000","last_clean":"2024-09-16T07:52:44.369630+0000","last_became_active":"2024-09-16T07:52:31.542828+0000","last_became_peered":"2024-09-16T07:52:31.542828+0000","last_unstale":"2024-09-16T07:52:44.369630+0000","last_undegraded":"2024-09-16T07:52:44.369630+0000","last_fullsized":"2024-09-16T07:52:44.369630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.336378+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:52:32.336378+0000","last_peered":"2024-09-16T07:52:32.336378+0000","last_clean":"2024-09-16T07:52:32.336378+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:52:32.336378+0000","last_undegraded":"2024-09-16T07:52:32.336378+0000","last_fullsized":"2024-09-16T07:52:32.336378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"76'136","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.068487+0000","last_change":"2024-09-16T07:52:31.625673+0000","last_active":"2024-09-16T07:52:43.068487+0000","last_peered":"2024-09-16T07:52:43.068487+0000","last_clean":"2024-09-16T07:52:43.068487+0000","last_became_active":"2024-09-16T07:52:31.621163+0000","last_became_peered":"2024-09-16T07:52:31.621163+0000","last_unstale":"2024-09-16T07:52:43.068487+0000","last_undegraded":"2024-09-16T07:52:43.068487+0000","last_fullsized":"2024-09-16T07:52:43.068487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.334916+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:52:32.334916+0000","last_peered":"2024-09-16T07:52:32.334916+0000","last_clean":"2024-09-16T07:52:32.334916+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:52:32.334916+0000","last_undegraded":"2024-09-16T07:52:32.334916+0000","last_fullsized":"2024-09-16T07:52:32.334916+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"76'128","reported_seq":140,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.083713+0000","last_change":"2024-09-16T07:52:31.516071+0000","last_active":"2024-09-16T07:52:44.083713+0000","last_peered":"2024-09-16T07:52:44.083713+0000","last_clean":"2024-09-16T07:52:44.083713+0000","last_became_active":"2024-09-16T07:52:31.508923+0000","last_became_peered":"2024-09-16T07:52:31.508923+0000","last_unstale":"2024-09-16T07:52:44.083713+0000","last_undegraded":"2024-09-16T07:52:44.083713+0000","last_fullsized":"2024-09-16T07:52:44.083713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332525+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:52:32.332525+0000","last_peered":"2024-09-16T07:52:32.332525+0000","last_clean":"2024-09-16T07:52:32.332525+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:52:32.332525+0000","last_undegraded":"2024-09-16T07:52:32.332525+0000","last_fullsized":"2024-09-16T07:52:32.332525+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"76'120","reported_seq":132,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:43.336500+0000","last_change":"2024-09-16T07:52:31.593107+0000","last_active":"2024-09-16T07:52:43.336500+0000","last_peered":"2024-09-16T07:52:43.336500+0000","last_clean":"2024-09-16T07:52:43.336500+0000","last_became_active":"2024-09-16T07:52:31.587475+0000","last_became_peered":"2024-09-16T07:52:31.587475+0000","last_unstale":"2024-09-16T07:52:43.336500+0000","last_undegraded":"2024-09-16T07:52:43.336500+0000","last_fullsized":"2024-09-16T07:52:43.336500+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.331320+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:52:32.331320+0000","last_peered":"2024-09-16T07:52:32.331320+0000","last_clean":"2024-09-16T07:52:32.331320+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:52:32.331320+0000","last_undegraded":"2024-09-16T07:52:32.331320+0000","last_fullsized":"2024-09-16T07:52:32.331320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"76'200","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.159765+0000","last_change":"2024-09-16T07:52:31.517765+0000","last_active":"2024-09-16T07:52:44.159765+0000","last_peered":"2024-09-16T07:52:44.159765+0000","last_clean":"2024-09-16T07:52:44.159765+0000","last_became_active":"2024-09-16T07:52:31.508464+0000","last_became_peered":"2024-09-16T07:52:31.508464+0000","last_unstale":"2024-09-16T07:52:44.159765+0000","last_undegraded":"2024-09-16T07:52:44.159765+0000","last_fullsized":"2024-09-16T07:52:44.159765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638400,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.325734+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:52:32.325734+0000","last_peered":"2024-09-16T07:52:32.325734+0000","last_clean":"2024-09-16T07:52:32.325734+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:52:32.325734+0000","last_undegraded":"2024-09-16T07:52:32.325734+0000","last_fullsized":"2024-09-16T07:52:32.325734+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"76'52","reported_seq":64,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:44.767796+0000","last_change":"2024-09-16T07:52:31.504993+0000","last_active":"2024-09-16T07:52:44.767796+0000","last_peered":"2024-09-16T07:52:44.767796+0000","last_clean":"2024-09-16T07:52:44.767796+0000","last_became_active":"2024-09-16T07:52:31.493993+0000","last_became_peered":"2024-09-16T07:52:31.493993+0000","last_unstale":"2024-09-16T07:52:44.767796+0000","last_undegraded":"2024-09-16T07:52:44.767796+0000","last_fullsized":"2024-09-16T07:52:44.767796+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425984,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.327152+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:52:32.327152+0000","last_peered":"2024-09-16T07:52:32.327152+0000","last_clean":"2024-09-16T07:52:32.327152+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:52:32.327152+0000","last_undegraded":"2024-09-16T07:52:32.327152+0000","last_fullsized":"2024-09-16T07:52:32.327152+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":17465344,"num_objects":267,"num_object_clones":0,"num_object_copies":801,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2132,"num_write_kb":17056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26157056,"data_stored":52314112,"data_compressed":2697948,"data_compressed_allocated":26157056,"data_compressed_original":52314112,"omap_allocated":0,"internal_metadata":0},"log_size":2132,"ondisk_log_size":2132,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":131940,"kb_used_data":6548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94239900,"statfs":{"total":96636764160,"available":96501657600,"internally_reserved":0,"allocated":6705152,"data_stored":12333671,"data_compressed":623532,"data_compressed_allocated":6045696,"data_compressed_original":12091392,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":49436,"kb_used_data":7820,"kb_used_omap":0,"kb_used_meta":41600,"kb_avail":94322404,"statfs":{"total":96636764160,"available":96586141696,"internally_reserved":0,"allocated":8007680,"data_stored":15406215,"data_compressed":781564,"data_compressed_allocated":7327744,"data_compressed_original":15147008,"omap_allocated":0,"internal_metadata":42598400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123400,"kb_used_data":6328,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94248440,"statfs":{"total":96636764160,"available":96510402560,"internally_reserved":0,"allocated":6479872,"data_stored":12350599,"data_compressed":624009,"data_compressed_allocated":5799936,"data_compressed_original":12091392,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":38316,"kb_used_data":6172,"kb_used_omap":0,"kb_used_meta":32128,"kb_avail":94333524,"statfs":{"total":96636764160,"available":96597528576,"internally_reserved":0,"allocated":6320128,"data_stored":12039284,"data_compressed":607943,"data_compressed_allocated":5644288,"data_compressed_original":11780096,"omap_allocated":0,"internal_metadata":32899072},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":11919360,"data_compressed":614707,"data_compressed_allocated":5959680,"data_compressed_original":11919360,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6164480,"data_stored":12328960,"data_compressed":635849,"data_compressed_allocated":6164480,"data_compressed_original":12328960,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7544832,"data_stored":15089664,"data_compressed":778176,"data_compressed_allocated":7544832,"data_compressed_original":15089664,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6488064,"data_stored":12976128,"data_compressed":669216,"data_compressed_allocated":6488064,"data_compressed_original":12976128,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:15.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 43 16 7290 7274 1.32147 1.33594 0.092743 0.0944695 2024-09-16T07:53:16.383 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:16.460 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 44 16 7452 7436 1.32019 1.26562 0.0795324 0.0945644 2024-09-16T07:53:16.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:16.512+0000 7f71ae657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:16.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:16.519+0000 7f71ae657640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:17.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 45 16 7621 7605 1.32019 1.32031 0.0614654 0.0945751 2024-09-16T07:53:18.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 46 16 7768 7752 1.31646 1.14844 0.18709 0.0947247 2024-09-16T07:53:18.684 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:18.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:18.824+0000 7f7b4587d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:18.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:18.831+0000 7f7b4587d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:19.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 47 16 7921 7905 1.31388 1.19531 0.0572395 0.0950246 2024-09-16T07:53:20.093 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:20.093 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:20.093 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:53:20.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:53:20.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:20.221+0000 7fc9582ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:20.238+0000 7fc9582ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:20.260 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:20.263 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:20.264 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:20.264 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:53:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:20.397+0000 7fb630b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:20.411+0000 7fb630b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.446 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:20.446 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:20.446 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:20.446 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:20.447 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:20.447 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:20.447 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:20.447 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:20.447 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:20.447 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:20.447 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:20.447 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:20.450 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:20.451 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:20.451 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:53:20.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 48 16 8060 8044 1.30913 1.08594 0.092557 0.0953162 2024-09-16T07:53:20.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:20.583+0000 7fd382f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:20.595+0000 7fd382f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.614 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:20.614 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:20.615 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:20.617 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:20.618 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:20.618 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:53:20.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:20.794+0000 7f18b1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:20.807+0000 7f18b1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:20.866 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:20.867 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:20.869 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:20.870 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:21.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:21.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:21.245+0000 7fb93e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:21.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:21.256+0000 7fb93e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:21.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 49 16 8219 8203 1.30776 1.24219 0.120812 0.0953482 2024-09-16T07:53:22.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 50 16 8381 8365 1.30691 1.26562 0.0871218 0.095526 2024-09-16T07:53:23.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 51 16 8514 8498 1.30166 1.03906 0.12897 0.0958392 2024-09-16T07:53:23.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:23.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:23.739+0000 7f17428d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:23.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:23.746+0000 7f17428d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:24.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 52 16 8658 8642 1.29826 1.125 0.112656 0.0961508 2024-09-16T07:53:25.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 53 16 8811 8795 1.29632 1.19531 0.112261 0.096247 2024-09-16T07:53:25.870 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:25.870 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:25.871 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:26.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:26.015+0000 7f87122a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:26.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:26.024+0000 7f87122a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:26.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:26.287 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:53:26.288 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:53:26.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:26.291+0000 7f02862fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:26.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:26.299+0000 7f02862fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:26.309 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":479,"stamp":"2024-09-16T07:53:25.857595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":59245107,"num_objects":900,"num_object_clones":0,"num_object_copies":2700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7241,"num_write_kb":58388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7215,"ondisk_log_size":7215,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331536,"kb_used_data":87440,"kb_used_omap":0,"kb_used_meta":244032,"kb_avail":377155824,"statfs":{"total":386547056640,"available":386207563776,"internally_reserved":0,"allocated":89538560,"data_stored":176181225,"data_compressed":9042537,"data_compressed_allocated":86843392,"data_compressed_original":175161344,"omap_allocated":0,"internal_metadata":249888768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41189376,"num_objects":629,"num_object_clones":0,"num_object_copies":1887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5028,"num_write_kb":40224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002550"},"pg_stats":[{"pgid":"10.7","version":"76'448","reported_seq":460,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.029925+0000","last_change":"2024-09-16T07:52:31.529234+0000","last_active":"2024-09-16T07:53:14.029925+0000","last_peered":"2024-09-16T07:53:14.029925+0000","last_clean":"2024-09-16T07:53:14.029925+0000","last_became_active":"2024-09-16T07:52:31.522933+0000","last_became_peered":"2024-09-16T07:52:31.522933+0000","last_unstale":"2024-09-16T07:53:14.029925+0000","last_undegraded":"2024-09-16T07:53:14.029925+0000","last_fullsized":"2024-09-16T07:53:14.029925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.6","version":"76'400","reported_seq":412,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.988022+0000","last_change":"2024-09-16T07:52:31.536407+0000","last_active":"2024-09-16T07:53:13.988022+0000","last_peered":"2024-09-16T07:53:13.988022+0000","last_clean":"2024-09-16T07:53:13.988022+0000","last_became_active":"2024-09-16T07:52:31.524816+0000","last_became_peered":"2024-09-16T07:52:31.524816+0000","last_unstale":"2024-09-16T07:53:13.988022+0000","last_undegraded":"2024-09-16T07:53:13.988022+0000","last_fullsized":"2024-09-16T07:53:13.988022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"76'480","reported_seq":492,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.451823+0000","last_change":"2024-09-16T07:52:31.564841+0000","last_active":"2024-09-16T07:53:14.451823+0000","last_peered":"2024-09-16T07:53:14.451823+0000","last_clean":"2024-09-16T07:53:14.451823+0000","last_became_active":"2024-09-16T07:52:31.557270+0000","last_became_peered":"2024-09-16T07:52:31.557270+0000","last_unstale":"2024-09-16T07:53:14.451823+0000","last_undegraded":"2024-09-16T07:53:14.451823+0000","last_fullsized":"2024-09-16T07:53:14.451823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"76'352","reported_seq":364,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.906263+0000","last_change":"2024-09-16T07:52:31.530991+0000","last_active":"2024-09-16T07:53:13.906263+0000","last_peered":"2024-09-16T07:53:13.906263+0000","last_clean":"2024-09-16T07:53:13.906263+0000","last_became_active":"2024-09-16T07:52:31.518106+0000","last_became_peered":"2024-09-16T07:52:31.518106+0000","last_unstale":"2024-09-16T07:53:13.906263+0000","last_undegraded":"2024-09-16T07:53:13.906263+0000","last_fullsized":"2024-09-16T07:53:13.906263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"76'376","reported_seq":388,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.663660+0000","last_change":"2024-09-16T07:52:31.575541+0000","last_active":"2024-09-16T07:53:14.663660+0000","last_peered":"2024-09-16T07:53:14.663660+0000","last_clean":"2024-09-16T07:53:14.663660+0000","last_became_active":"2024-09-16T07:52:31.557936+0000","last_became_peered":"2024-09-16T07:52:31.557936+0000","last_unstale":"2024-09-16T07:53:14.663660+0000","last_undegraded":"2024-09-16T07:53:14.663660+0000","last_fullsized":"2024-09-16T07:53:14.663660+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"76'552","reported_seq":564,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.521395+0000","last_change":"2024-09-16T07:52:31.529903+0000","last_active":"2024-09-16T07:53:14.521395+0000","last_peered":"2024-09-16T07:53:14.521395+0000","last_clean":"2024-09-16T07:53:14.521395+0000","last_became_active":"2024-09-16T07:52:31.488561+0000","last_became_peered":"2024-09-16T07:52:31.488561+0000","last_unstale":"2024-09-16T07:53:14.521395+0000","last_undegraded":"2024-09-16T07:53:14.521395+0000","last_fullsized":"2024-09-16T07:53:14.521395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"76'400","reported_seq":412,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.760696+0000","last_change":"2024-09-16T07:52:31.564066+0000","last_active":"2024-09-16T07:53:13.760696+0000","last_peered":"2024-09-16T07:53:13.760696+0000","last_clean":"2024-09-16T07:53:13.760696+0000","last_became_active":"2024-09-16T07:52:31.553855+0000","last_became_peered":"2024-09-16T07:52:31.553855+0000","last_unstale":"2024-09-16T07:53:13.760696+0000","last_undegraded":"2024-09-16T07:53:13.760696+0000","last_fullsized":"2024-09-16T07:53:13.760696+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"76'384","reported_seq":396,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.859360+0000","last_change":"2024-09-16T07:52:31.533468+0000","last_active":"2024-09-16T07:53:13.859360+0000","last_peered":"2024-09-16T07:53:13.859360+0000","last_clean":"2024-09-16T07:53:13.859360+0000","last_became_active":"2024-09-16T07:52:31.519514+0000","last_became_peered":"2024-09-16T07:52:31.519514+0000","last_unstale":"2024-09-16T07:53:13.859360+0000","last_undegraded":"2024-09-16T07:53:13.859360+0000","last_fullsized":"2024-09-16T07:53:13.859360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"76'504","reported_seq":516,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.569129+0000","last_change":"2024-09-16T07:52:31.582944+0000","last_active":"2024-09-16T07:53:14.569129+0000","last_peered":"2024-09-16T07:53:14.569129+0000","last_clean":"2024-09-16T07:53:14.569129+0000","last_became_active":"2024-09-16T07:52:31.569089+0000","last_became_peered":"2024-09-16T07:52:31.569089+0000","last_unstale":"2024-09-16T07:53:14.569129+0000","last_undegraded":"2024-09-16T07:53:14.569129+0000","last_fullsized":"2024-09-16T07:53:14.569129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.326289+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:52:32.326289+0000","last_peered":"2024-09-16T07:52:32.326289+0000","last_clean":"2024-09-16T07:52:32.326289+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:52:32.326289+0000","last_undegraded":"2024-09-16T07:52:32.326289+0000","last_fullsized":"2024-09-16T07:52:32.326289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332443+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:52:32.332443+0000","last_peered":"2024-09-16T07:52:32.332443+0000","last_clean":"2024-09-16T07:52:32.332443+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:52:32.332443+0000","last_undegraded":"2024-09-16T07:52:32.332443+0000","last_fullsized":"2024-09-16T07:52:32.332443+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"76'488","reported_seq":500,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.428423+0000","last_change":"2024-09-16T07:52:31.525007+0000","last_active":"2024-09-16T07:53:14.428423+0000","last_peered":"2024-09-16T07:53:14.428423+0000","last_clean":"2024-09-16T07:53:14.428423+0000","last_became_active":"2024-09-16T07:52:31.504171+0000","last_became_peered":"2024-09-16T07:52:31.504171+0000","last_unstale":"2024-09-16T07:53:14.428423+0000","last_undegraded":"2024-09-16T07:53:14.428423+0000","last_fullsized":"2024-09-16T07:53:14.428423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.324714+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:52:32.324714+0000","last_peered":"2024-09-16T07:52:32.324714+0000","last_clean":"2024-09-16T07:52:32.324714+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:52:32.324714+0000","last_undegraded":"2024-09-16T07:52:32.324714+0000","last_fullsized":"2024-09-16T07:52:32.324714+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"76'512","reported_seq":524,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.076879+0000","last_change":"2024-09-16T07:52:31.555379+0000","last_active":"2024-09-16T07:53:13.076879+0000","last_peered":"2024-09-16T07:53:13.076879+0000","last_clean":"2024-09-16T07:53:13.076879+0000","last_became_active":"2024-09-16T07:52:31.542828+0000","last_became_peered":"2024-09-16T07:52:31.542828+0000","last_unstale":"2024-09-16T07:53:13.076879+0000","last_undegraded":"2024-09-16T07:53:13.076879+0000","last_fullsized":"2024-09-16T07:53:13.076879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.336378+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:52:32.336378+0000","last_peered":"2024-09-16T07:52:32.336378+0000","last_clean":"2024-09-16T07:52:32.336378+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:52:32.336378+0000","last_undegraded":"2024-09-16T07:52:32.336378+0000","last_fullsized":"2024-09-16T07:52:32.336378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"76'491","reported_seq":503,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.769181+0000","last_change":"2024-09-16T07:52:31.625673+0000","last_active":"2024-09-16T07:53:14.769181+0000","last_peered":"2024-09-16T07:53:14.769181+0000","last_clean":"2024-09-16T07:53:14.769181+0000","last_became_active":"2024-09-16T07:52:31.621163+0000","last_became_peered":"2024-09-16T07:52:31.621163+0000","last_unstale":"2024-09-16T07:53:14.769181+0000","last_undegraded":"2024-09-16T07:53:14.769181+0000","last_fullsized":"2024-09-16T07:53:14.769181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4022272,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":491,"num_write_kb":3928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.334916+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:52:32.334916+0000","last_peered":"2024-09-16T07:52:32.334916+0000","last_clean":"2024-09-16T07:52:32.334916+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:52:32.334916+0000","last_undegraded":"2024-09-16T07:52:32.334916+0000","last_fullsized":"2024-09-16T07:52:32.334916+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"76'496","reported_seq":508,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.715533+0000","last_change":"2024-09-16T07:52:31.516071+0000","last_active":"2024-09-16T07:53:14.715533+0000","last_peered":"2024-09-16T07:53:14.715533+0000","last_clean":"2024-09-16T07:53:14.715533+0000","last_became_active":"2024-09-16T07:52:31.508923+0000","last_became_peered":"2024-09-16T07:52:31.508923+0000","last_unstale":"2024-09-16T07:53:14.715533+0000","last_undegraded":"2024-09-16T07:53:14.715533+0000","last_fullsized":"2024-09-16T07:53:14.715533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332525+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:52:32.332525+0000","last_peered":"2024-09-16T07:52:32.332525+0000","last_clean":"2024-09-16T07:52:32.332525+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:52:32.332525+0000","last_undegraded":"2024-09-16T07:52:32.332525+0000","last_fullsized":"2024-09-16T07:52:32.332525+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"76'408","reported_seq":420,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.602140+0000","last_change":"2024-09-16T07:52:31.593107+0000","last_active":"2024-09-16T07:53:14.602140+0000","last_peered":"2024-09-16T07:53:14.602140+0000","last_clean":"2024-09-16T07:53:14.602140+0000","last_became_active":"2024-09-16T07:52:31.587475+0000","last_became_peered":"2024-09-16T07:52:31.587475+0000","last_unstale":"2024-09-16T07:53:14.602140+0000","last_undegraded":"2024-09-16T07:53:14.602140+0000","last_fullsized":"2024-09-16T07:53:14.602140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.331320+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:52:32.331320+0000","last_peered":"2024-09-16T07:52:32.331320+0000","last_clean":"2024-09-16T07:52:32.331320+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:52:32.331320+0000","last_undegraded":"2024-09-16T07:52:32.331320+0000","last_fullsized":"2024-09-16T07:52:32.331320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"76'493","reported_seq":505,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.763127+0000","last_change":"2024-09-16T07:52:31.517765+0000","last_active":"2024-09-16T07:53:14.763127+0000","last_peered":"2024-09-16T07:53:14.763127+0000","last_clean":"2024-09-16T07:53:14.763127+0000","last_became_active":"2024-09-16T07:52:31.508464+0000","last_became_peered":"2024-09-16T07:52:31.508464+0000","last_unstale":"2024-09-16T07:53:14.763127+0000","last_undegraded":"2024-09-16T07:53:14.763127+0000","last_fullsized":"2024-09-16T07:53:14.763127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4038656,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":3944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.325734+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:52:32.325734+0000","last_peered":"2024-09-16T07:52:32.325734+0000","last_clean":"2024-09-16T07:52:32.325734+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:52:32.325734+0000","last_undegraded":"2024-09-16T07:52:32.325734+0000","last_fullsized":"2024-09-16T07:52:32.325734+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"76'376","reported_seq":388,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.121258+0000","last_change":"2024-09-16T07:52:31.504993+0000","last_active":"2024-09-16T07:53:14.121258+0000","last_peered":"2024-09-16T07:53:14.121258+0000","last_clean":"2024-09-16T07:53:14.121258+0000","last_became_active":"2024-09-16T07:52:31.493993+0000","last_became_peered":"2024-09-16T07:52:31.493993+0000","last_unstale":"2024-09-16T07:53:14.121258+0000","last_undegraded":"2024-09-16T07:53:14.121258+0000","last_fullsized":"2024-09-16T07:53:14.121258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.327152+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:52:32.327152+0000","last_peered":"2024-09-16T07:52:32.327152+0000","last_clean":"2024-09-16T07:52:32.327152+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:52:32.327152+0000","last_undegraded":"2024-09-16T07:52:32.327152+0000","last_fullsized":"2024-09-16T07:52:32.327152+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":58654720,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7160,"num_write_kb":57280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87969792,"data_stored":175939584,"data_compressed":9081441,"data_compressed_allocated":87969792,"data_compressed_original":175939584,"omap_allocated":0,"internal_metadata":0},"log_size":7160,"ondisk_log_size":7160,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58176,"kb_used_data":21552,"kb_used_omap":0,"kb_used_meta":36608,"kb_avail":94313664,"statfs":{"total":96636764160,"available":96577191936,"internally_reserved":0,"allocated":22069248,"data_stored":43061863,"data_compressed":2210205,"data_compressed_allocated":21409792,"data_compressed_original":42819584,"omap_allocated":0,"internal_metadata":37486592},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71184,"kb_used_data":25408,"kb_used_omap":0,"kb_used_meta":45760,"kb_avail":94300656,"statfs":{"total":96636764160,"available":96563871744,"internally_reserved":0,"allocated":26017792,"data_stored":51426439,"data_compressed":2641495,"data_compressed_allocated":25337856,"data_compressed_original":51167232,"omap_allocated":0,"internal_metadata":46858240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154080,"kb_used_data":20368,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94217760,"statfs":{"total":96636764160,"available":96478986240,"internally_reserved":0,"allocated":20856832,"data_stored":41104519,"data_compressed":2108739,"data_compressed_allocated":20176896,"data_compressed_original":40845312,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48096,"kb_used_data":20112,"kb_used_omap":0,"kb_used_meta":27968,"kb_avail":94323744,"statfs":{"total":96636764160,"available":96587513856,"internally_reserved":0,"allocated":20594688,"data_stored":40588404,"data_compressed":2082098,"data_compressed_allocated":19918848,"data_compressed_original":40329216,"omap_allocated":0,"internal_metadata":28639232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20221952,"data_stored":40443904,"data_compressed":2087593,"data_compressed_allocated":20221952,"data_compressed_original":40443904,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20525056,"data_stored":41050112,"data_compressed":2118887,"data_compressed_allocated":20525056,"data_compressed_original":41050112,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25530368,"data_stored":51060736,"data_compressed":2635569,"data_compressed_allocated":25530368,"data_compressed_original":51060736,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21692416,"data_stored":43384832,"data_compressed":2239392,"data_compressed_allocated":21692416,"data_compressed_original":43384832,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:26.461 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 54 16 8959 8943 1.29372 1.15625 0.0865403 0.0965088 2024-09-16T07:53:27.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 55 15 9125 9110 1.29392 1.30469 0.0788301 0.0965282 2024-09-16T07:53:28.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 56 16 9259 9243 1.28936 1.03906 0.0929064 0.0968156 2024-09-16T07:53:28.476 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:28.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:28.596+0000 7f59110fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:28.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:28.602+0000 7f59110fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:29.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 57 16 9418 9402 1.28854 1.24219 0.111748 0.0968852 2024-09-16T07:53:30.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 58 16 9574 9558 1.28733 1.21875 0.0977531 0.0970057 2024-09-16T07:53:30.979 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:31.132+0000 7fe2c6ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:31.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:31.142+0000 7fe2c6ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:31.310 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:31.311 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:31.311 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:53:31.311 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:53:31.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:31.448+0000 7fa301c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:31.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:31.458+0000 7fa301c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:31.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 59 16 9723 9707 1.28524 1.16406 0.135593 0.0971006 2024-09-16T07:53:31.478 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:31.478 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:31.478 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:31.478 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:31.478 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:31.479 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:31.479 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:31.479 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:31.479 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:31.479 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:31.479 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:31.479 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:31.482 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:31.482 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:31.482 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:53:31.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:31.609+0000 7ff15046c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:31.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:31.620+0000 7ff15046c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:31.643 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:31.644 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:31.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:53:31.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:31.810+0000 7f81e4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:31.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:31.825+0000 7f81e4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:31.883 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:31.884 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:31.887 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:31.887 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:31.888 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:53:32.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:32.033+0000 7fb2e6d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:32.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:32.046+0000 7fb2e6d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:32.127 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:32.131 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:32.131 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:32.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:53:32.464122+0000 min lat: 0.0164956 max lat: 0.290033 avg lat: 0.0970655 2024-09-16T07:53:32.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:53:32.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 60 16 9894 9878 1.28608 1.33594 0.136354 0.0970655 2024-09-16T07:53:33.402 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:33.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 61 16 10038 10022 1.28344 1.125 0.0871952 0.0973034 2024-09-16T07:53:33.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:33.550+0000 7fa5af0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:33.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:33.556+0000 7fa5af0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:34.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 62 16 10169 10153 1.27924 1.02344 0.163662 0.0976111 2024-09-16T07:53:35.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 63 16 10332 10316 1.27915 1.27344 0.0651222 0.0976429 2024-09-16T07:53:35.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:35.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:35.921+0000 7f67a4f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:35.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:35.930+0000 7f67a4f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:36.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 64 16 10466 10450 1.27552 1.04688 0.131602 0.0978617 2024-09-16T07:53:37.131 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:37.132 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:37.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:53:37.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:37.255+0000 7fef9bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:37.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:37.265+0000 7fef9bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:37.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 65 16 10609 10593 1.27308 1.11719 0.126077 0.098067 2024-09-16T07:53:37.501 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:53:37.502 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:53:37.517 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":484,"stamp":"2024-09-16T07:53:35.859635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":59245107,"num_objects":900,"num_object_clones":0,"num_object_copies":2700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7241,"num_write_kb":58388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7215,"ondisk_log_size":7215,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":331536,"kb_used_data":87440,"kb_used_omap":0,"kb_used_meta":244032,"kb_avail":377155824,"statfs":{"total":386547056640,"available":386207563776,"internally_reserved":0,"allocated":89538560,"data_stored":176181225,"data_compressed":9042537,"data_compressed_allocated":86843392,"data_compressed_original":175161344,"omap_allocated":0,"internal_metadata":249888768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002487"},"pg_stats":[{"pgid":"10.7","version":"76'448","reported_seq":460,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.029925+0000","last_change":"2024-09-16T07:52:31.529234+0000","last_active":"2024-09-16T07:53:14.029925+0000","last_peered":"2024-09-16T07:53:14.029925+0000","last_clean":"2024-09-16T07:53:14.029925+0000","last_became_active":"2024-09-16T07:52:31.522933+0000","last_became_peered":"2024-09-16T07:52:31.522933+0000","last_unstale":"2024-09-16T07:53:14.029925+0000","last_undegraded":"2024-09-16T07:53:14.029925+0000","last_fullsized":"2024-09-16T07:53:14.029925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":448,"num_write_kb":3584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.6","version":"76'400","reported_seq":412,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.988022+0000","last_change":"2024-09-16T07:52:31.536407+0000","last_active":"2024-09-16T07:53:13.988022+0000","last_peered":"2024-09-16T07:53:13.988022+0000","last_clean":"2024-09-16T07:53:13.988022+0000","last_became_active":"2024-09-16T07:52:31.524816+0000","last_became_peered":"2024-09-16T07:52:31.524816+0000","last_unstale":"2024-09-16T07:53:13.988022+0000","last_undegraded":"2024-09-16T07:53:13.988022+0000","last_fullsized":"2024-09-16T07:53:13.988022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"76'480","reported_seq":492,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.451823+0000","last_change":"2024-09-16T07:52:31.564841+0000","last_active":"2024-09-16T07:53:14.451823+0000","last_peered":"2024-09-16T07:53:14.451823+0000","last_clean":"2024-09-16T07:53:14.451823+0000","last_became_active":"2024-09-16T07:52:31.557270+0000","last_became_peered":"2024-09-16T07:52:31.557270+0000","last_unstale":"2024-09-16T07:53:14.451823+0000","last_undegraded":"2024-09-16T07:53:14.451823+0000","last_fullsized":"2024-09-16T07:53:14.451823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3932160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":480,"num_write_kb":3840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"76'352","reported_seq":364,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.906263+0000","last_change":"2024-09-16T07:52:31.530991+0000","last_active":"2024-09-16T07:53:13.906263+0000","last_peered":"2024-09-16T07:53:13.906263+0000","last_clean":"2024-09-16T07:53:13.906263+0000","last_became_active":"2024-09-16T07:52:31.518106+0000","last_became_peered":"2024-09-16T07:52:31.518106+0000","last_unstale":"2024-09-16T07:53:13.906263+0000","last_undegraded":"2024-09-16T07:53:13.906263+0000","last_fullsized":"2024-09-16T07:53:13.906263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":352,"num_write_kb":2816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"76'376","reported_seq":388,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.663660+0000","last_change":"2024-09-16T07:52:31.575541+0000","last_active":"2024-09-16T07:53:14.663660+0000","last_peered":"2024-09-16T07:53:14.663660+0000","last_clean":"2024-09-16T07:53:14.663660+0000","last_became_active":"2024-09-16T07:52:31.557936+0000","last_became_peered":"2024-09-16T07:52:31.557936+0000","last_unstale":"2024-09-16T07:53:14.663660+0000","last_undegraded":"2024-09-16T07:53:14.663660+0000","last_fullsized":"2024-09-16T07:53:14.663660+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"76'552","reported_seq":564,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.521395+0000","last_change":"2024-09-16T07:52:31.529903+0000","last_active":"2024-09-16T07:53:14.521395+0000","last_peered":"2024-09-16T07:53:14.521395+0000","last_clean":"2024-09-16T07:53:14.521395+0000","last_became_active":"2024-09-16T07:52:31.488561+0000","last_became_peered":"2024-09-16T07:52:31.488561+0000","last_unstale":"2024-09-16T07:53:14.521395+0000","last_undegraded":"2024-09-16T07:53:14.521395+0000","last_fullsized":"2024-09-16T07:53:14.521395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4521984,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"76'400","reported_seq":412,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.760696+0000","last_change":"2024-09-16T07:52:31.564066+0000","last_active":"2024-09-16T07:53:13.760696+0000","last_peered":"2024-09-16T07:53:13.760696+0000","last_clean":"2024-09-16T07:53:13.760696+0000","last_became_active":"2024-09-16T07:52:31.553855+0000","last_became_peered":"2024-09-16T07:52:31.553855+0000","last_unstale":"2024-09-16T07:53:13.760696+0000","last_undegraded":"2024-09-16T07:53:13.760696+0000","last_fullsized":"2024-09-16T07:53:13.760696+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3276800,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":400,"num_write_kb":3200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.0","version":"76'384","reported_seq":396,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.859360+0000","last_change":"2024-09-16T07:52:31.533468+0000","last_active":"2024-09-16T07:53:13.859360+0000","last_peered":"2024-09-16T07:53:13.859360+0000","last_clean":"2024-09-16T07:53:13.859360+0000","last_became_active":"2024-09-16T07:52:31.519514+0000","last_became_peered":"2024-09-16T07:52:31.519514+0000","last_unstale":"2024-09-16T07:53:13.859360+0000","last_undegraded":"2024-09-16T07:53:13.859360+0000","last_fullsized":"2024-09-16T07:53:13.859360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":384,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"76'504","reported_seq":516,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.569129+0000","last_change":"2024-09-16T07:52:31.582944+0000","last_active":"2024-09-16T07:53:14.569129+0000","last_peered":"2024-09-16T07:53:14.569129+0000","last_clean":"2024-09-16T07:53:14.569129+0000","last_became_active":"2024-09-16T07:52:31.569089+0000","last_became_peered":"2024-09-16T07:52:31.569089+0000","last_unstale":"2024-09-16T07:53:14.569129+0000","last_undegraded":"2024-09-16T07:53:14.569129+0000","last_fullsized":"2024-09-16T07:53:14.569129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4128768,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":504,"num_write_kb":4032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":271,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.326289+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:52:32.326289+0000","last_peered":"2024-09-16T07:52:32.326289+0000","last_clean":"2024-09-16T07:52:32.326289+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:52:32.326289+0000","last_undegraded":"2024-09-16T07:52:32.326289+0000","last_fullsized":"2024-09-16T07:52:32.326289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":203,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332443+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:52:32.332443+0000","last_peered":"2024-09-16T07:52:32.332443+0000","last_clean":"2024-09-16T07:52:32.332443+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:52:32.332443+0000","last_undegraded":"2024-09-16T07:52:32.332443+0000","last_fullsized":"2024-09-16T07:52:32.332443+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"76'488","reported_seq":500,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.428423+0000","last_change":"2024-09-16T07:52:31.525007+0000","last_active":"2024-09-16T07:53:14.428423+0000","last_peered":"2024-09-16T07:53:14.428423+0000","last_clean":"2024-09-16T07:53:14.428423+0000","last_became_active":"2024-09-16T07:52:31.504171+0000","last_became_peered":"2024-09-16T07:52:31.504171+0000","last_unstale":"2024-09-16T07:53:14.428423+0000","last_undegraded":"2024-09-16T07:53:14.428423+0000","last_fullsized":"2024-09-16T07:53:14.428423+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.324714+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:52:32.324714+0000","last_peered":"2024-09-16T07:52:32.324714+0000","last_clean":"2024-09-16T07:52:32.324714+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:52:32.324714+0000","last_undegraded":"2024-09-16T07:52:32.324714+0000","last_fullsized":"2024-09-16T07:52:32.324714+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"76'512","reported_seq":524,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:13.076879+0000","last_change":"2024-09-16T07:52:31.555379+0000","last_active":"2024-09-16T07:53:13.076879+0000","last_peered":"2024-09-16T07:53:13.076879+0000","last_clean":"2024-09-16T07:53:13.076879+0000","last_became_active":"2024-09-16T07:52:31.542828+0000","last_became_peered":"2024-09-16T07:52:31.542828+0000","last_unstale":"2024-09-16T07:53:13.076879+0000","last_undegraded":"2024-09-16T07:53:13.076879+0000","last_fullsized":"2024-09-16T07:53:13.076879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":512,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.336378+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:52:32.336378+0000","last_peered":"2024-09-16T07:52:32.336378+0000","last_clean":"2024-09-16T07:52:32.336378+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:52:32.336378+0000","last_undegraded":"2024-09-16T07:52:32.336378+0000","last_fullsized":"2024-09-16T07:52:32.336378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"76'491","reported_seq":503,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.769181+0000","last_change":"2024-09-16T07:52:31.625673+0000","last_active":"2024-09-16T07:53:14.769181+0000","last_peered":"2024-09-16T07:53:14.769181+0000","last_clean":"2024-09-16T07:53:14.769181+0000","last_became_active":"2024-09-16T07:52:31.621163+0000","last_became_peered":"2024-09-16T07:52:31.621163+0000","last_unstale":"2024-09-16T07:53:14.769181+0000","last_undegraded":"2024-09-16T07:53:14.769181+0000","last_fullsized":"2024-09-16T07:53:14.769181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4022272,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":491,"num_write_kb":3928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":204,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.334916+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:52:32.334916+0000","last_peered":"2024-09-16T07:52:32.334916+0000","last_clean":"2024-09-16T07:52:32.334916+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:52:32.334916+0000","last_undegraded":"2024-09-16T07:52:32.334916+0000","last_fullsized":"2024-09-16T07:52:32.334916+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"76'496","reported_seq":508,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.715533+0000","last_change":"2024-09-16T07:52:31.516071+0000","last_active":"2024-09-16T07:53:14.715533+0000","last_peered":"2024-09-16T07:53:14.715533+0000","last_clean":"2024-09-16T07:53:14.715533+0000","last_became_active":"2024-09-16T07:52:31.508923+0000","last_became_peered":"2024-09-16T07:52:31.508923+0000","last_unstale":"2024-09-16T07:53:14.715533+0000","last_undegraded":"2024-09-16T07:53:14.715533+0000","last_fullsized":"2024-09-16T07:53:14.715533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4063232,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.332525+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:52:32.332525+0000","last_peered":"2024-09-16T07:52:32.332525+0000","last_clean":"2024-09-16T07:52:32.332525+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:52:32.332525+0000","last_undegraded":"2024-09-16T07:52:32.332525+0000","last_fullsized":"2024-09-16T07:52:32.332525+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"76'408","reported_seq":420,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.602140+0000","last_change":"2024-09-16T07:52:31.593107+0000","last_active":"2024-09-16T07:53:14.602140+0000","last_peered":"2024-09-16T07:53:14.602140+0000","last_clean":"2024-09-16T07:53:14.602140+0000","last_became_active":"2024-09-16T07:52:31.587475+0000","last_became_peered":"2024-09-16T07:52:31.587475+0000","last_unstale":"2024-09-16T07:53:14.602140+0000","last_undegraded":"2024-09-16T07:53:14.602140+0000","last_fullsized":"2024-09-16T07:53:14.602140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":408,"num_write_kb":3264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.331320+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:52:32.331320+0000","last_peered":"2024-09-16T07:52:32.331320+0000","last_clean":"2024-09-16T07:52:32.331320+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:52:32.331320+0000","last_undegraded":"2024-09-16T07:52:32.331320+0000","last_fullsized":"2024-09-16T07:52:32.331320+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"76'493","reported_seq":505,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.763127+0000","last_change":"2024-09-16T07:52:31.517765+0000","last_active":"2024-09-16T07:53:14.763127+0000","last_peered":"2024-09-16T07:53:14.763127+0000","last_clean":"2024-09-16T07:53:14.763127+0000","last_became_active":"2024-09-16T07:52:31.508464+0000","last_became_peered":"2024-09-16T07:52:31.508464+0000","last_unstale":"2024-09-16T07:53:14.763127+0000","last_undegraded":"2024-09-16T07:53:14.763127+0000","last_fullsized":"2024-09-16T07:53:14.763127+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4038656,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":493,"num_write_kb":3944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.325734+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:52:32.325734+0000","last_peered":"2024-09-16T07:52:32.325734+0000","last_clean":"2024-09-16T07:52:32.325734+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:52:32.325734+0000","last_undegraded":"2024-09-16T07:52:32.325734+0000","last_fullsized":"2024-09-16T07:52:32.325734+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"76'376","reported_seq":388,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:53:14.121258+0000","last_change":"2024-09-16T07:52:31.504993+0000","last_active":"2024-09-16T07:53:14.121258+0000","last_peered":"2024-09-16T07:53:14.121258+0000","last_clean":"2024-09-16T07:53:14.121258+0000","last_became_active":"2024-09-16T07:52:31.493993+0000","last_became_peered":"2024-09-16T07:52:31.493993+0000","last_unstale":"2024-09-16T07:53:14.121258+0000","last_undegraded":"2024-09-16T07:53:14.121258+0000","last_fullsized":"2024-09-16T07:53:14.121258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:52:30.354840+0000","last_clean_scrub_stamp":"2024-09-16T07:52:30.354840+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":376,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":202,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-16T07:52:32.327152+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:52:32.327152+0000","last_peered":"2024-09-16T07:52:32.327152+0000","last_clean":"2024-09-16T07:52:32.327152+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:52:32.327152+0000","last_undegraded":"2024-09-16T07:52:32.327152+0000","last_fullsized":"2024-09-16T07:52:32.327152+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":16,"stat_sum":{"num_bytes":58654720,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7160,"num_write_kb":57280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87969792,"data_stored":175939584,"data_compressed":9081441,"data_compressed_allocated":87969792,"data_compressed_original":175939584,"omap_allocated":0,"internal_metadata":0},"log_size":7160,"ondisk_log_size":7160,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58176,"kb_used_data":21552,"kb_used_omap":0,"kb_used_meta":36608,"kb_avail":94313664,"statfs":{"total":96636764160,"available":96577191936,"internally_reserved":0,"allocated":22069248,"data_stored":43061863,"data_compressed":2210205,"data_compressed_allocated":21409792,"data_compressed_original":42819584,"omap_allocated":0,"internal_metadata":37486592},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71184,"kb_used_data":25408,"kb_used_omap":0,"kb_used_meta":45760,"kb_avail":94300656,"statfs":{"total":96636764160,"available":96563871744,"internally_reserved":0,"allocated":26017792,"data_stored":51426439,"data_compressed":2641495,"data_compressed_allocated":25337856,"data_compressed_original":51167232,"omap_allocated":0,"internal_metadata":46858240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154080,"kb_used_data":20368,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94217760,"statfs":{"total":96636764160,"available":96478986240,"internally_reserved":0,"allocated":20856832,"data_stored":41104519,"data_compressed":2108739,"data_compressed_allocated":20176896,"data_compressed_original":40845312,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":48096,"kb_used_data":20112,"kb_used_omap":0,"kb_used_meta":27968,"kb_avail":94323744,"statfs":{"total":96636764160,"available":96587513856,"internally_reserved":0,"allocated":20594688,"data_stored":40588404,"data_compressed":2082098,"data_compressed_allocated":19918848,"data_compressed_original":40329216,"omap_allocated":0,"internal_metadata":28639232},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20221952,"data_stored":40443904,"data_compressed":2087593,"data_compressed_allocated":20221952,"data_compressed_original":40443904,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20525056,"data_stored":41050112,"data_compressed":2118887,"data_compressed_allocated":20525056,"data_compressed_original":41050112,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25530368,"data_stored":51060736,"data_compressed":2635569,"data_compressed_allocated":25530368,"data_compressed_original":51060736,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21692416,"data_stored":43384832,"data_compressed":2239392,"data_compressed_allocated":21692416,"data_compressed_original":43384832,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:53:38.311 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:38.450+0000 7fec350a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:38.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:38.458+0000 7fec350a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:38.462 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 66 16 10763 10747 1.27202 1.20312 0.0449884 0.0981721 2024-09-16T07:53:39.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 67 16 10901 10885 1.26912 1.07812 0.150325 0.0984297 2024-09-16T07:53:40.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 68 16 11046 11030 1.26712 1.13281 0.149144 0.0985243 2024-09-16T07:53:40.789 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:40.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:40.919+0000 7fe28bca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:40.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:40.927+0000 7fe28bca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:41.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 69 16 11172 11156 1.26302 0.984375 0.136939 0.0988417 2024-09-16T07:53:42.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 70 16 11330 11314 1.26261 1.23438 0.0641653 0.0989425 2024-09-16T07:53:42.519 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:42.520 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:42.520 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:53:42.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:53:42.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:42.674+0000 7f616fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:42.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:42.686+0000 7f616fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:42.710 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:42.711 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:42.711 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:42.711 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:42.714 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:42.715 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:42.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:53:42.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:42.843+0000 7f9902f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:42.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:42.854+0000 7f9902f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:42.955 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:42.955 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:42.956 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:42.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:42.962 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:42.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:53:43.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:43.103+0000 7f8ac4711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:43.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:43.116+0000 7f8ac4711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:43.138 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:43.138 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:43.138 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:43.138 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:43.138 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:43.139 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:43.139 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:43.139 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:43.139 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:43.139 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:43.139 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:43.139 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:43.141 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:43.142 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:43.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:53:43.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:43.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:43.300+0000 7f0198591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:43.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:43.316+0000 7f0198591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:43.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:43.336+0000 7f7776591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:43.342 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:43.342 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:43.342 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:43.342 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:43.342 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:43.342 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:43.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:43.342+0000 7f7776591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:43.343 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:43.343 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:43.343 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:43.343 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:43.343 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:43.343 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:43.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:43.348 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:43.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 71 16 11477 11461 1.261 1.14844 0.222452 0.098967 2024-09-16T07:53:44.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 72 16 11636 11620 1.26074 1.24219 0.0910247 0.0990599 2024-09-16T07:53:45.463 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 73 16 11774 11758 1.25823 1.07812 0.155897 0.0992536 2024-09-16T07:53:45.592 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:45.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:45.737+0000 7f8fc52d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:45.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:45.745+0000 7f8fc52d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:46.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 74 16 11928 11912 1.25749 1.20312 0.103941 0.0993016 2024-09-16T07:53:47.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 75 16 12068 12052 1.2553 1.09375 0.15901 0.0994565 2024-09-16T07:53:47.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:48.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:48.089+0000 7ff19bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:48.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:48.096+0000 7ff19bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:48.349 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:48.349 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:48.349 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:53:48.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:53:48.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 76 16 12195 12179 1.25184 0.992188 0.0924227 0.0997086 2024-09-16T07:53:48.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:48.482+0000 7fb9eb511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:48.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:48.494+0000 7fb9eb511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:48.628 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:48.628 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:48.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:53:48.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:48.770+0000 7f8913e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:48.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:48.783+0000 7f8913e5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:48.819 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:48.820 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:48.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:53:48.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:48.934+0000 7f7ec34fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:48.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:48.947+0000 7f7ec34fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:48.964 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:48.965 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:48.965 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:48.967 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:48.967 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:48.968 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:53:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:49.122+0000 7f090a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:49.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:49.135+0000 7f090a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:49.159 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:49.160 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:49.163 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:49.164 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:49.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 77 16 12348 12332 1.2511 1.19531 0.0559353 0.0998433 2024-09-16T07:53:50.391 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:50.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 78 16 12493 12477 1.24958 1.13281 0.0905535 0.0999549 2024-09-16T07:53:50.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:50.547+0000 7f9538d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:50.554+0000 7f9538d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:51.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 79 16 12638 12622 1.2481 1.13281 0.135313 0.100026 2024-09-16T07:53:52.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:2024-09-16T07:53:52.466089+0000 min lat: 0.0164956 max lat: 0.290033 avg lat: 0.100234 2024-09-16T07:53:52.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-16T07:53:52.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 80 16 12779 12763 1.24627 1.10156 0.0546683 0.100234 2024-09-16T07:53:52.890 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:53.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:53.012+0000 7f78a4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:53.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:53.019+0000 7f78a4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:53.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 81 16 12907 12891 1.24323 1 0.187805 0.100476 2024-09-16T07:53:54.165 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:53:54.165 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:53:54.165 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:53:54.165 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:53:54.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:54.309+0000 7fd053d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:54.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:54.325+0000 7fd053d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:54.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 82 16 13041 13025 1.24083 1.04688 0.101418 0.100672 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:54.518 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:54.519 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:54.519 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:54.519 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:54.521 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:54.522 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:54.522 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:53:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:54.673+0000 7fcf158d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:54.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:54.683+0000 7fcf158d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:54.702 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:54.702 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:54.703 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:54.704 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:54.704 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:54.704 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:54.705 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:54.706 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:54.706 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:53:54.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:54.843+0000 7f3c94948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:54.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:54.856+0000 7f3c94948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:54.897 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:54.898 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:54.898 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:54.898 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:54.902 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:54.902 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:54.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:53:55.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:55.060+0000 7f4ab4711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:55.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:55.073+0000 7f4ab4711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:55.169 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:53:55.170 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:53:55.173 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:53:55.174 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:53:55.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:53:55.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:55.446+0000 7f07c4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:55.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:55.454+0000 7f07c4791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:55.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 83 16 13192 13176 1.2401 1.17969 0.0448325 0.100698 2024-09-16T07:53:56.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 84 16 13327 13311 1.23789 1.05469 0.114328 0.100909 2024-09-16T07:53:57.464 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 85 16 13472 13456 1.23665 1.13281 0.12022 0.101038 2024-09-16T07:53:57.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:53:58.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:58.004+0000 7f2a13d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:58.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:53:58.012+0000 7f2a13d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:53:58.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 86 16 13624 13608 1.23608 1.1875 0.112896 0.101084 2024-09-16T07:53:59.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 87 16 13738 13722 1.23211 0.890625 0.045233 0.101396 2024-09-16T07:54:00.174 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:54:00.175 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:54:00.175 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:54:00.175 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:54:00.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:00.323+0000 7fadbbea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:00.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:00.335+0000 7fadbbea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:00.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:00.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 88 16 13887 13871 1.23133 1.16406 0.0728814 0.101449 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:00.475 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:00.476 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:00.476 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:00.476 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:00.480 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:00.480 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:00.481 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:54:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:00.486+0000 7ff6beb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:00.493+0000 7ff6beb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:00.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:00.628+0000 7f902b49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:00.641+0000 7f902b49c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:00.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:00.685 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:00.685 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:54:00.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:00.879+0000 7ff177d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:00.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:00.893+0000 7ff177d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:00.957 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:00.958 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:00.958 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:00.958 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:00.958 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:00.958 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:00.958 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:00.959 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:00.959 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:00.959 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:00.959 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:00.959 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:00.961 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:00.961 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:00.962 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:54:01.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:01.119+0000 7fa65f297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:01.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:01.133+0000 7fa65f297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:01.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:01.163 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:01.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 89 16 14033 14017 1.23031 1.14062 0.0631054 0.101571 2024-09-16T07:54:02.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout: 90 16 14151 14135 1.22688 0.921875 0.104923 0.101793 2024-09-16T07:54:02.932 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:03.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:03.039+0000 7f076a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:03.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:03.045+0000 7f076a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:03.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total time run: 90.0962 2024-09-16T07:54:03.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Total writes made: 14151 2024-09-16T07:54:03.465 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Write size: 8192 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Object size: 65536 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Bandwidth (MB/sec): 1.22707 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Bandwidth: 0.130446 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max bandwidth (MB/sec): 1.47656 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min bandwidth (MB/sec): 0.890625 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average IOPS: 157 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev IOPS: 16.6971 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max IOPS: 189 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min IOPS: 114 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Average Latency(s): 0.101825 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Stddev Latency(s): 0.0417224 2024-09-16T07:54:03.466 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Max latency(s): 0.290033 2024-09-16T07:54:03.467 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Min latency(s): 0.0164956 2024-09-16T07:54:03.488 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Cleaning up (deleting benchmark objects) 2024-09-16T07:54:05.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:05.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:05.279+0000 7f8c0e646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:05.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:05.287+0000 7f8c0e646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.164 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:54:06.164 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:54:06.164 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:54:06.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:54:06.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:06.302+0000 7ff9d20bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:06.320+0000 7ff9d20bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:06.366 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:06.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:06.370 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:06.371 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:54:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:06.512+0000 7f6f9cafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:06.525+0000 7f6f9cafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.580 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:06.580 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:06.580 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:06.580 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:06.580 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:06.580 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:06.580 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:06.581 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:06.581 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:06.581 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:06.581 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:06.581 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:06.584 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:06.584 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:06.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:54:06.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:06.728+0000 7fe29227f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:06.740+0000 7fe29227f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:06.833 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:06.834 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:06.836 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:06.837 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:06.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:54:07.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:06.996+0000 7f8e6e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:07.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:07.012+0000 7f8e6e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:07.093 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:07.093 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:07.093 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:07.093 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:07.093 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:07.093 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:07.093 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:07.094 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:07.094 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:07.094 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:07.094 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:07.094 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:07.096 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:07.096 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:07.562 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:07.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:07.705+0000 7f1a790d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:07.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:07.713+0000 7f1a790d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:10.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:10.188+0000 7f4e70191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:10.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:10.193+0000 7f4e70191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.097 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-16T07:54:12.098 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-16T07:54:12.098 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-16T07:54:12.098 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-16T07:54:12.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:12.242+0000 7f5b78f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:12.253+0000 7f5b78f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:12.282 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:12.285 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:12.285 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:12.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-16T07:54:12.402 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:12.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:12.432+0000 7f9140f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:12.451+0000 7f913b59e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:12.572+0000 7ff6be991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:12.582+0000 7ff6be991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:12.648 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:12.649 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:12.653 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:12.653 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:12.653 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-16T07:54:12.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:12.827+0000 7fb00487f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:12.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:12.840+0000 7fb00487f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:13.088 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:13.089 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:13.090 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:13.092 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:13.093 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:13.093 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-16T07:54:13.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:13.286+0000 7ff9e8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:13.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:13.300+0000 7ff9e8b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:13.403 INFO:teuthology.orchestra.run.smithi137.stderr:no valid command found; 10 closest matches: 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:bench [] [] [] [] 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:config get 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:config help 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:config set ... 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:config show 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:deep_scrub 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_ops 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:dump_historic_slow_ops 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:dump_metrics [] 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:dump_ops_in_flight 2024-09-16T07:54:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:Error EINVAL: invalid command 2024-09-16T07:54:13.408 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-16T07:54:13.408 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-16T07:54:13.685 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Removed 1769 objects 2024-09-16T07:54:13.686 INFO:tasks.radosbench.radosbench.0.smithi137.stdout:Clean up completed and total clean up time :10.1979 2024-09-16T07:54:14.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-16T07:54:14.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:14.954+0000 7fa49bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:14.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:14.960+0000 7fa49bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:16.117 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_7 2024-09-16T07:54:16.117 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_7 unique_pool_7 --yes-i-really-really-mean-it 2024-09-16T07:54:16.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:16.225+0000 7f46ec711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:16.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:16.237+0000 7f46ec711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:17.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-16T07:54:17.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:17.170+0000 7f7502b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:17.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:17.175+0000 7f7502b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:17.342 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'unique_pool_7' removed 2024-09-16T07:54:17.359 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-16T07:54:17.369 INFO:tasks.thrashosds:joining thrashosds 2024-09-16T07:54:18.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-16T07:54:18.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:18.522+0000 7f800f708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:18.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:18.527+0000 7f800f708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:18.541 INFO:teuthology.orchestra.run.smithi137.stdout:{} 2024-09-16T07:54:18.541 INFO:teuthology.orchestra.run.smithi137.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-16T07:54:18.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-16T07:54:18.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:18.656+0000 7f6a6d111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:18.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:18.665+0000 7f6a6d111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:19.357 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.0 to 1 (10000) 2024-09-16T07:54:19.376 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-16T07:54:19.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:19.483+0000 7f12beb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:19.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:19.493+0000 7f12beb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:20.367 INFO:teuthology.orchestra.run.smithi137.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-16T07:54:20.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-16T07:54:20.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:20.494+0000 7fb911991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:20.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:20.504+0000 7fb911991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:21.377 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.1 to 1 (10000) 2024-09-16T07:54:21.399 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-16T07:54:21.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:21.504+0000 7f12c407d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:21.514+0000 7f12c407d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:22.385 INFO:teuthology.orchestra.run.smithi137.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-16T07:54:22.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-16T07:54:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:22.516+0000 7f69f9e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:22.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:22.526+0000 7f69f9e88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.392 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.2 to 1 (10000) 2024-09-16T07:54:23.413 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-16T07:54:23.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:23.520+0000 7f8c60791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:23.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:23.529+0000 7f8c60791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-16T07:54:24.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-16T07:54:24.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:24.539+0000 7f73dd311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:24.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:24.549+0000 7f73dd311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:reweighted osd.3 to 1 (10000) 2024-09-16T07:54:25.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-16T07:54:25.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:25.537+0000 7fa89f8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:25.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:25.547+0000 7fa89f8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.423 INFO:teuthology.orchestra.run.smithi137.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-16T07:54:26.443 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-16T07:54:26.443 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T07:54:26.444 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:54:26.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:26.550+0000 7fccfac93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:26.558+0000 7fccfac93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.746 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:26.746 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":85,"fsid":"ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803","created":"2024-09-16T07:39:37.227795+0000","modified":"2024-09-16T07:54:26.418805+0000","last_up_change":"2024-09-16T07:39:44.702046+0000","last_in_change":"2024-09-16T07:39:39.340153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:39:45.716296+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:39:47.454199+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"04953245-7929-4d22-9c69-528c0bf85165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6801","nonce":2719564590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2719564590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2719564590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":2719564590}]},"public_addr":"172.21.15.137:6801/2719564590","cluster_addr":"172.21.15.137:6800/2719564590","heartbeat_back_addr":"172.21.15.137:6802/2719564590","heartbeat_front_addr":"172.21.15.137:6803/2719564590","state":["exists","up"]},{"osd":1,"uuid":"3d6ab8ec-fe47-4181-91c6-bc884de20fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":1191756675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":1191756675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":1191756675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1191756675}]},"public_addr":"172.21.15.137:6807/1191756675","cluster_addr":"172.21.15.137:6808/1191756675","heartbeat_back_addr":"172.21.15.137:6805/1191756675","heartbeat_front_addr":"172.21.15.137:6806/1191756675","state":["exists","up"]},{"osd":2,"uuid":"1826ced5-0469-410d-8e8b-172b170fb655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6803","nonce":3119845536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3119845536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6809","nonce":3119845536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3119845536}]},"public_addr":"172.21.15.170:6803/3119845536","cluster_addr":"172.21.15.170:6804/3119845536","heartbeat_back_addr":"172.21.15.170:6809/3119845536","heartbeat_front_addr":"172.21.15.170:6810/3119845536","state":["exists","up"]},{"osd":3,"uuid":"f8f5be82-c330-44a2-b341-caba448da614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3642008203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6807","nonce":3642008203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6811","nonce":3642008203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3642008203}]},"public_addr":"172.21.15.170:6808/3642008203","cluster_addr":"172.21.15.170:6807/3642008203","heartbeat_back_addr":"172.21.15.170:6811/3642008203","heartbeat_front_addr":"172.21.15.170:6812/3642008203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:54:26.760 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T07:54:26.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:54:26.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:26.865+0000 7fcaab2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:26.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:26.873+0000 7fcaab2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.058 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:27.058 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":85,"fsid":"ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803","created":"2024-09-16T07:39:37.227795+0000","modified":"2024-09-16T07:54:26.418805+0000","last_up_change":"2024-09-16T07:39:44.702046+0000","last_in_change":"2024-09-16T07:39:39.340153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:39:45.716296+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:39:47.454199+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"04953245-7929-4d22-9c69-528c0bf85165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6801","nonce":2719564590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2719564590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2719564590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":2719564590}]},"public_addr":"172.21.15.137:6801/2719564590","cluster_addr":"172.21.15.137:6800/2719564590","heartbeat_back_addr":"172.21.15.137:6802/2719564590","heartbeat_front_addr":"172.21.15.137:6803/2719564590","state":["exists","up"]},{"osd":1,"uuid":"3d6ab8ec-fe47-4181-91c6-bc884de20fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":1191756675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":1191756675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":1191756675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1191756675}]},"public_addr":"172.21.15.137:6807/1191756675","cluster_addr":"172.21.15.137:6808/1191756675","heartbeat_back_addr":"172.21.15.137:6805/1191756675","heartbeat_front_addr":"172.21.15.137:6806/1191756675","state":["exists","up"]},{"osd":2,"uuid":"1826ced5-0469-410d-8e8b-172b170fb655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6803","nonce":3119845536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3119845536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6809","nonce":3119845536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3119845536}]},"public_addr":"172.21.15.170:6803/3119845536","cluster_addr":"172.21.15.170:6804/3119845536","heartbeat_back_addr":"172.21.15.170:6809/3119845536","heartbeat_front_addr":"172.21.15.170:6810/3119845536","state":["exists","up"]},{"osd":3,"uuid":"f8f5be82-c330-44a2-b341-caba448da614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3642008203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6807","nonce":3642008203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6811","nonce":3642008203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3642008203}]},"public_addr":"172.21.15.170:6808/3642008203","cluster_addr":"172.21.15.170:6807/3642008203","heartbeat_back_addr":"172.21.15.170:6811/3642008203","heartbeat_front_addr":"172.21.15.170:6812/3642008203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:54:27.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T07:54:27.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T07:54:27.073 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T07:54:27.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T07:54:27.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.190+0000 7f6df36fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.190+0000 7f8520f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.190+0000 7f1d60d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.190+0000 7faf612d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.200+0000 7f6df36fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.201+0000 7f8520f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.201+0000 7faf612d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.201+0000 7f1d60d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.239 INFO:teuthology.orchestra.run.smithi137.stdout:38654706545 2024-09-16T07:54:27.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:54:27.241 INFO:teuthology.orchestra.run.smithi137.stdout:38654706544 2024-09-16T07:54:27.241 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:54:27.242 INFO:teuthology.orchestra.run.smithi137.stdout:38654706545 2024-09-16T07:54:27.242 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T07:54:27.243 INFO:teuthology.orchestra.run.smithi137.stdout:38654706545 2024-09-16T07:54:27.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:54:27.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.399+0000 7f23984d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.399+0000 7fda9b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.399+0000 7f095d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.400+0000 7f8026991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.408+0000 7fda9b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.409+0000 7f095d791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.409+0000 7f23984d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:27.411+0000 7f8026991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:27.607 INFO:teuthology.orchestra.run.smithi137.stdout:38654706532 2024-09-16T07:54:27.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706545 got 38654706532 for osd.0 2024-09-16T07:54:27.628 INFO:teuthology.orchestra.run.smithi137.stdout:38654706532 2024-09-16T07:54:27.628 INFO:teuthology.orchestra.run.smithi137.stdout:38654706532 2024-09-16T07:54:27.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706545 got 38654706532 for osd.1 2024-09-16T07:54:27.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706544 got 38654706532 for osd.2 2024-09-16T07:54:27.651 INFO:teuthology.orchestra.run.smithi137.stdout:38654706532 2024-09-16T07:54:27.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706545 got 38654706532 for osd.3 2024-09-16T07:54:28.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T07:54:28.643 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T07:54:28.648 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T07:54:28.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T07:54:28.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:28.739+0000 7ff6080d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:28.753+0000 7ff6080d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:28.785+0000 7f39c3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:28.788+0000 7f4933551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:28.794+0000 7f39c3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:28.790+0000 7fb1e9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:28.799+0000 7f4933551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:28.801+0000 7fb1e9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:28.967 INFO:teuthology.orchestra.run.smithi137.stdout:38654706545 2024-09-16T07:54:28.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706545 got 38654706545 for osd.0 2024-09-16T07:54:28.982 DEBUG:teuthology.parallel:result is None 2024-09-16T07:54:29.008 INFO:teuthology.orchestra.run.smithi137.stdout:38654706545 2024-09-16T07:54:29.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706545 got 38654706545 for osd.1 2024-09-16T07:54:29.022 DEBUG:teuthology.parallel:result is None 2024-09-16T07:54:29.041 INFO:teuthology.orchestra.run.smithi137.stdout:38654706544 2024-09-16T07:54:29.046 INFO:teuthology.orchestra.run.smithi137.stdout:38654706545 2024-09-16T07:54:29.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706544 got 38654706544 for osd.2 2024-09-16T07:54:29.056 DEBUG:teuthology.parallel:result is None 2024-09-16T07:54:29.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706545 got 38654706545 for osd.3 2024-09-16T07:54:29.060 DEBUG:teuthology.parallel:result is None 2024-09-16T07:54:29.060 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-16T07:54:29.060 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:29.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:29.205+0000 7fced52d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:29.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:29.213+0000 7fced52d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:29.395 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:29.395 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:54:29.408 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2024-09-16T07:54:27.870243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":251800,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":249600,"kb_avail":377235560,"statfs":{"total":386547056640,"available":386289213440,"internally_reserved":0,"allocated":2179072,"data_stored":2520865,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":255590400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.473062"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439882+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:54:26.439882+0000","last_peered":"2024-09-16T07:54:26.439882+0000","last_clean":"2024-09-16T07:54:26.439882+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:54:26.439882+0000","last_undegraded":"2024-09-16T07:54:26.439882+0000","last_fullsized":"2024-09-16T07:54:26.439882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439090+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:54:26.439090+0000","last_peered":"2024-09-16T07:54:26.439090+0000","last_clean":"2024-09-16T07:54:26.439090+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:54:26.439090+0000","last_undegraded":"2024-09-16T07:54:26.439090+0000","last_fullsized":"2024-09-16T07:54:26.439090+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.437124+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:54:26.437124+0000","last_peered":"2024-09-16T07:54:26.437124+0000","last_clean":"2024-09-16T07:54:26.437124+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:54:26.437124+0000","last_undegraded":"2024-09-16T07:54:26.437124+0000","last_fullsized":"2024-09-16T07:54:26.437124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439672+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:54:26.439672+0000","last_peered":"2024-09-16T07:54:26.439672+0000","last_clean":"2024-09-16T07:54:26.439672+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:54:26.439672+0000","last_undegraded":"2024-09-16T07:54:26.439672+0000","last_fullsized":"2024-09-16T07:54:26.439672+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439036+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:54:26.439036+0000","last_peered":"2024-09-16T07:54:26.439036+0000","last_clean":"2024-09-16T07:54:26.439036+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:54:26.439036+0000","last_undegraded":"2024-09-16T07:54:26.439036+0000","last_fullsized":"2024-09-16T07:54:26.439036+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442212+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:54:26.442212+0000","last_peered":"2024-09-16T07:54:26.442212+0000","last_clean":"2024-09-16T07:54:26.442212+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:54:26.442212+0000","last_undegraded":"2024-09-16T07:54:26.442212+0000","last_fullsized":"2024-09-16T07:54:26.442212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442646+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:54:26.442646+0000","last_peered":"2024-09-16T07:54:26.442646+0000","last_clean":"2024-09-16T07:54:26.442646+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:54:26.442646+0000","last_undegraded":"2024-09-16T07:54:26.442646+0000","last_fullsized":"2024-09-16T07:54:26.442646+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.438475+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:54:26.438475+0000","last_peered":"2024-09-16T07:54:26.438475+0000","last_clean":"2024-09-16T07:54:26.438475+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:54:26.438475+0000","last_undegraded":"2024-09-16T07:54:26.438475+0000","last_fullsized":"2024-09-16T07:54:26.438475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.436649+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:54:26.436649+0000","last_peered":"2024-09-16T07:54:26.436649+0000","last_clean":"2024-09-16T07:54:26.436649+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:54:26.436649+0000","last_undegraded":"2024-09-16T07:54:26.436649+0000","last_fullsized":"2024-09-16T07:54:26.436649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28792,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":28288,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":499712,"data_stored":187445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28966912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60220,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":59648,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":61079552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125940,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245900,"statfs":{"total":96636764160,"available":96507801600,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36848,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":36288,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":557056,"data_stored":777794,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":37158912},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:29.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:29.514+0000 7febd2646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:29.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:29.522+0000 7febd2646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:29.706 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:29.706 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:54:29.720 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2024-09-16T07:54:27.870243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":251800,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":249600,"kb_avail":377235560,"statfs":{"total":386547056640,"available":386289213440,"internally_reserved":0,"allocated":2179072,"data_stored":2520865,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":255590400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.473062"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439882+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:54:26.439882+0000","last_peered":"2024-09-16T07:54:26.439882+0000","last_clean":"2024-09-16T07:54:26.439882+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:54:26.439882+0000","last_undegraded":"2024-09-16T07:54:26.439882+0000","last_fullsized":"2024-09-16T07:54:26.439882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439090+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:54:26.439090+0000","last_peered":"2024-09-16T07:54:26.439090+0000","last_clean":"2024-09-16T07:54:26.439090+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:54:26.439090+0000","last_undegraded":"2024-09-16T07:54:26.439090+0000","last_fullsized":"2024-09-16T07:54:26.439090+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.437124+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:54:26.437124+0000","last_peered":"2024-09-16T07:54:26.437124+0000","last_clean":"2024-09-16T07:54:26.437124+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:54:26.437124+0000","last_undegraded":"2024-09-16T07:54:26.437124+0000","last_fullsized":"2024-09-16T07:54:26.437124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439672+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:54:26.439672+0000","last_peered":"2024-09-16T07:54:26.439672+0000","last_clean":"2024-09-16T07:54:26.439672+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:54:26.439672+0000","last_undegraded":"2024-09-16T07:54:26.439672+0000","last_fullsized":"2024-09-16T07:54:26.439672+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439036+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:54:26.439036+0000","last_peered":"2024-09-16T07:54:26.439036+0000","last_clean":"2024-09-16T07:54:26.439036+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:54:26.439036+0000","last_undegraded":"2024-09-16T07:54:26.439036+0000","last_fullsized":"2024-09-16T07:54:26.439036+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442212+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:54:26.442212+0000","last_peered":"2024-09-16T07:54:26.442212+0000","last_clean":"2024-09-16T07:54:26.442212+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:54:26.442212+0000","last_undegraded":"2024-09-16T07:54:26.442212+0000","last_fullsized":"2024-09-16T07:54:26.442212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442646+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:54:26.442646+0000","last_peered":"2024-09-16T07:54:26.442646+0000","last_clean":"2024-09-16T07:54:26.442646+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:54:26.442646+0000","last_undegraded":"2024-09-16T07:54:26.442646+0000","last_fullsized":"2024-09-16T07:54:26.442646+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.438475+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:54:26.438475+0000","last_peered":"2024-09-16T07:54:26.438475+0000","last_clean":"2024-09-16T07:54:26.438475+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:54:26.438475+0000","last_undegraded":"2024-09-16T07:54:26.438475+0000","last_fullsized":"2024-09-16T07:54:26.438475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.436649+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:54:26.436649+0000","last_peered":"2024-09-16T07:54:26.436649+0000","last_clean":"2024-09-16T07:54:26.436649+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:54:26.436649+0000","last_undegraded":"2024-09-16T07:54:26.436649+0000","last_fullsized":"2024-09-16T07:54:26.436649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28792,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":28288,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":499712,"data_stored":187445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28966912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60220,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":59648,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":61079552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125940,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245900,"statfs":{"total":96636764160,"available":96507801600,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36848,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":36288,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":557056,"data_stored":777794,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":37158912},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:29.721 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-16T07:54:29.721 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-16T07:54:29.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:29.827+0000 7f01e3311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:29.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:29.837+0000 7f01e3311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:30.040 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T07:54:30.049 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T07:54:30.050 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:30.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:30.155+0000 7f2ea6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:30.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:30.163+0000 7f2ea6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:30.345 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:30.346 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:54:30.359 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2024-09-16T07:54:29.870750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":251800,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":249600,"kb_avail":377235560,"statfs":{"total":386547056640,"available":386289213440,"internally_reserved":0,"allocated":2179072,"data_stored":2520865,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":255590400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001591"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439882+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:54:26.439882+0000","last_peered":"2024-09-16T07:54:26.439882+0000","last_clean":"2024-09-16T07:54:26.439882+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:54:26.439882+0000","last_undegraded":"2024-09-16T07:54:26.439882+0000","last_fullsized":"2024-09-16T07:54:26.439882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439090+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:54:26.439090+0000","last_peered":"2024-09-16T07:54:26.439090+0000","last_clean":"2024-09-16T07:54:26.439090+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:54:26.439090+0000","last_undegraded":"2024-09-16T07:54:26.439090+0000","last_fullsized":"2024-09-16T07:54:26.439090+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.437124+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:54:26.437124+0000","last_peered":"2024-09-16T07:54:26.437124+0000","last_clean":"2024-09-16T07:54:26.437124+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:54:26.437124+0000","last_undegraded":"2024-09-16T07:54:26.437124+0000","last_fullsized":"2024-09-16T07:54:26.437124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439672+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:54:26.439672+0000","last_peered":"2024-09-16T07:54:26.439672+0000","last_clean":"2024-09-16T07:54:26.439672+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:54:26.439672+0000","last_undegraded":"2024-09-16T07:54:26.439672+0000","last_fullsized":"2024-09-16T07:54:26.439672+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439036+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:54:26.439036+0000","last_peered":"2024-09-16T07:54:26.439036+0000","last_clean":"2024-09-16T07:54:26.439036+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:54:26.439036+0000","last_undegraded":"2024-09-16T07:54:26.439036+0000","last_fullsized":"2024-09-16T07:54:26.439036+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442212+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:54:26.442212+0000","last_peered":"2024-09-16T07:54:26.442212+0000","last_clean":"2024-09-16T07:54:26.442212+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:54:26.442212+0000","last_undegraded":"2024-09-16T07:54:26.442212+0000","last_fullsized":"2024-09-16T07:54:26.442212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442646+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:54:26.442646+0000","last_peered":"2024-09-16T07:54:26.442646+0000","last_clean":"2024-09-16T07:54:26.442646+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:54:26.442646+0000","last_undegraded":"2024-09-16T07:54:26.442646+0000","last_fullsized":"2024-09-16T07:54:26.442646+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.438475+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:54:26.438475+0000","last_peered":"2024-09-16T07:54:26.438475+0000","last_clean":"2024-09-16T07:54:26.438475+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:54:26.438475+0000","last_undegraded":"2024-09-16T07:54:26.438475+0000","last_fullsized":"2024-09-16T07:54:26.438475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.436649+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:54:26.436649+0000","last_peered":"2024-09-16T07:54:26.436649+0000","last_clean":"2024-09-16T07:54:26.436649+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:54:26.436649+0000","last_undegraded":"2024-09-16T07:54:26.436649+0000","last_fullsized":"2024-09-16T07:54:26.436649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28792,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":28288,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":499712,"data_stored":187445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28966912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60220,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":59648,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":61079552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125940,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245900,"statfs":{"total":96636764160,"available":96507801600,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36848,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":36288,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":557056,"data_stored":777794,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":37158912},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:30.360 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:30.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:30.467+0000 7f3977f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:30.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:30.475+0000 7f3977f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:30.658 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:54:30.671 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2024-09-16T07:54:29.870750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":251800,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":249600,"kb_avail":377235560,"statfs":{"total":386547056640,"available":386289213440,"internally_reserved":0,"allocated":2179072,"data_stored":2520865,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":255590400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001591"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439882+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:54:26.439882+0000","last_peered":"2024-09-16T07:54:26.439882+0000","last_clean":"2024-09-16T07:54:26.439882+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:54:26.439882+0000","last_undegraded":"2024-09-16T07:54:26.439882+0000","last_fullsized":"2024-09-16T07:54:26.439882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439090+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:54:26.439090+0000","last_peered":"2024-09-16T07:54:26.439090+0000","last_clean":"2024-09-16T07:54:26.439090+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:54:26.439090+0000","last_undegraded":"2024-09-16T07:54:26.439090+0000","last_fullsized":"2024-09-16T07:54:26.439090+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.437124+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:54:26.437124+0000","last_peered":"2024-09-16T07:54:26.437124+0000","last_clean":"2024-09-16T07:54:26.437124+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:54:26.437124+0000","last_undegraded":"2024-09-16T07:54:26.437124+0000","last_fullsized":"2024-09-16T07:54:26.437124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439672+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:54:26.439672+0000","last_peered":"2024-09-16T07:54:26.439672+0000","last_clean":"2024-09-16T07:54:26.439672+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:54:26.439672+0000","last_undegraded":"2024-09-16T07:54:26.439672+0000","last_fullsized":"2024-09-16T07:54:26.439672+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439036+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:54:26.439036+0000","last_peered":"2024-09-16T07:54:26.439036+0000","last_clean":"2024-09-16T07:54:26.439036+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:54:26.439036+0000","last_undegraded":"2024-09-16T07:54:26.439036+0000","last_fullsized":"2024-09-16T07:54:26.439036+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442212+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:54:26.442212+0000","last_peered":"2024-09-16T07:54:26.442212+0000","last_clean":"2024-09-16T07:54:26.442212+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:54:26.442212+0000","last_undegraded":"2024-09-16T07:54:26.442212+0000","last_fullsized":"2024-09-16T07:54:26.442212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442646+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:54:26.442646+0000","last_peered":"2024-09-16T07:54:26.442646+0000","last_clean":"2024-09-16T07:54:26.442646+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:54:26.442646+0000","last_undegraded":"2024-09-16T07:54:26.442646+0000","last_fullsized":"2024-09-16T07:54:26.442646+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.438475+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:54:26.438475+0000","last_peered":"2024-09-16T07:54:26.438475+0000","last_clean":"2024-09-16T07:54:26.438475+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:54:26.438475+0000","last_undegraded":"2024-09-16T07:54:26.438475+0000","last_fullsized":"2024-09-16T07:54:26.438475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.436649+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:54:26.436649+0000","last_peered":"2024-09-16T07:54:26.436649+0000","last_clean":"2024-09-16T07:54:26.436649+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:54:26.436649+0000","last_undegraded":"2024-09-16T07:54:26.436649+0000","last_fullsized":"2024-09-16T07:54:26.436649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28792,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":28288,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":499712,"data_stored":187445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28966912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60220,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":59648,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":61079552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125940,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245900,"statfs":{"total":96636764160,"available":96507801600,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36848,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":36288,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":557056,"data_stored":777794,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":37158912},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:30.672 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T07:54:30.672 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:30.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:30.777+0000 7fdc6ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:30.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:30.785+0000 7fdc6ccd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:30.967 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:30.968 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:54:30.981 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2024-09-16T07:54:29.870750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":251800,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":249600,"kb_avail":377235560,"statfs":{"total":386547056640,"available":386289213440,"internally_reserved":0,"allocated":2179072,"data_stored":2520865,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":255590400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001591"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439882+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:54:26.439882+0000","last_peered":"2024-09-16T07:54:26.439882+0000","last_clean":"2024-09-16T07:54:26.439882+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:54:26.439882+0000","last_undegraded":"2024-09-16T07:54:26.439882+0000","last_fullsized":"2024-09-16T07:54:26.439882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439090+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:54:26.439090+0000","last_peered":"2024-09-16T07:54:26.439090+0000","last_clean":"2024-09-16T07:54:26.439090+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:54:26.439090+0000","last_undegraded":"2024-09-16T07:54:26.439090+0000","last_fullsized":"2024-09-16T07:54:26.439090+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.437124+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:54:26.437124+0000","last_peered":"2024-09-16T07:54:26.437124+0000","last_clean":"2024-09-16T07:54:26.437124+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:54:26.437124+0000","last_undegraded":"2024-09-16T07:54:26.437124+0000","last_fullsized":"2024-09-16T07:54:26.437124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439672+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:54:26.439672+0000","last_peered":"2024-09-16T07:54:26.439672+0000","last_clean":"2024-09-16T07:54:26.439672+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:54:26.439672+0000","last_undegraded":"2024-09-16T07:54:26.439672+0000","last_fullsized":"2024-09-16T07:54:26.439672+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439036+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:54:26.439036+0000","last_peered":"2024-09-16T07:54:26.439036+0000","last_clean":"2024-09-16T07:54:26.439036+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:54:26.439036+0000","last_undegraded":"2024-09-16T07:54:26.439036+0000","last_fullsized":"2024-09-16T07:54:26.439036+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442212+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:54:26.442212+0000","last_peered":"2024-09-16T07:54:26.442212+0000","last_clean":"2024-09-16T07:54:26.442212+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:54:26.442212+0000","last_undegraded":"2024-09-16T07:54:26.442212+0000","last_fullsized":"2024-09-16T07:54:26.442212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442646+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:54:26.442646+0000","last_peered":"2024-09-16T07:54:26.442646+0000","last_clean":"2024-09-16T07:54:26.442646+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:54:26.442646+0000","last_undegraded":"2024-09-16T07:54:26.442646+0000","last_fullsized":"2024-09-16T07:54:26.442646+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.438475+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:54:26.438475+0000","last_peered":"2024-09-16T07:54:26.438475+0000","last_clean":"2024-09-16T07:54:26.438475+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:54:26.438475+0000","last_undegraded":"2024-09-16T07:54:26.438475+0000","last_fullsized":"2024-09-16T07:54:26.438475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.436649+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:54:26.436649+0000","last_peered":"2024-09-16T07:54:26.436649+0000","last_clean":"2024-09-16T07:54:26.436649+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:54:26.436649+0000","last_undegraded":"2024-09-16T07:54:26.436649+0000","last_fullsized":"2024-09-16T07:54:26.436649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28792,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":28288,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":499712,"data_stored":187445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28966912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60220,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":59648,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":61079552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125940,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245900,"statfs":{"total":96636764160,"available":96507801600,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36848,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":36288,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":557056,"data_stored":777794,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":37158912},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:30.982 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T07:54:31.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:31.088+0000 7fe6ae088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:31.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:31.096+0000 7fe6ae088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:31.283 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:31.283 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":85,"fsid":"ad6faeb0-dc7a-4caa-ac6b-4d8e75a51803","created":"2024-09-16T07:39:37.227795+0000","modified":"2024-09-16T07:54:26.418805+0000","last_up_change":"2024-09-16T07:39:44.702046+0000","last_in_change":"2024-09-16T07:39:39.340153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T07:39:45.716296+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T07:39:47.454199+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"04953245-7929-4d22-9c69-528c0bf85165","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6801","nonce":2719564590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":2719564590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":2719564590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6803","nonce":2719564590}]},"public_addr":"172.21.15.137:6801/2719564590","cluster_addr":"172.21.15.137:6800/2719564590","heartbeat_back_addr":"172.21.15.137:6802/2719564590","heartbeat_front_addr":"172.21.15.137:6803/2719564590","state":["exists","up"]},{"osd":1,"uuid":"3d6ab8ec-fe47-4181-91c6-bc884de20fe4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6807","nonce":1191756675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":1191756675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6805","nonce":1191756675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":1191756675}]},"public_addr":"172.21.15.137:6807/1191756675","cluster_addr":"172.21.15.137:6808/1191756675","heartbeat_back_addr":"172.21.15.137:6805/1191756675","heartbeat_front_addr":"172.21.15.137:6806/1191756675","state":["exists","up"]},{"osd":2,"uuid":"1826ced5-0469-410d-8e8b-172b170fb655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6803","nonce":3119845536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3119845536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6809","nonce":3119845536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":3119845536}]},"public_addr":"172.21.15.170:6803/3119845536","cluster_addr":"172.21.15.170:6804/3119845536","heartbeat_back_addr":"172.21.15.170:6809/3119845536","heartbeat_front_addr":"172.21.15.170:6810/3119845536","state":["exists","up"]},{"osd":3,"uuid":"f8f5be82-c330-44a2-b341-caba448da614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3642008203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6807","nonce":3642008203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6811","nonce":3642008203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":3642008203}]},"public_addr":"172.21.15.170:6808/3642008203","cluster_addr":"172.21.15.170:6807/3642008203","heartbeat_back_addr":"172.21.15.170:6811/3642008203","heartbeat_front_addr":"172.21.15.170:6812/3642008203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T07:54:32.298 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T07:54:32.298 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:54:32.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:32.412+0000 7f1df56d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:32.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:32.425+0000 7f1df56d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:32.440 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-16T07:54:32.440 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "" 2024-09-16T07:54:32.440 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-16T07:54:32.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T07:54:32.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:32.556+0000 7f38d3aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:32.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:32.565+0000 7f38d3aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:32.752 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T07:54:32.766 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T07:54:32.766 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:54:32.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:32.871+0000 7fbfc2d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:32.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:32.884+0000 7fbfc2d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:32.898 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-16T07:54:32.899 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "" 2024-09-16T07:54:32.899 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-16T07:54:32.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T07:54:33.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.014+0000 7f7ebd551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.023+0000 7f7ebd551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.209 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T07:54:33.230 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T07:54:33.230 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:54:33.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.336+0000 7f5a8e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.349+0000 7f5a8e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.363 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-16T07:54:33.364 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "" 2024-09-16T07:54:33.364 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-16T07:54:33.375 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T07:54:33.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.480+0000 7f3b400d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.489+0000 7f3b400d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.675 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T07:54:33.691 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T07:54:33.692 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T07:54:33.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.797+0000 7fa8826ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.810+0000 7fa8826ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-09-16T07:54:33.825 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "" 2024-09-16T07:54:33.825 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-09-16T07:54:33.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T07:54:33.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.941+0000 7f02e7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:33.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:33.950+0000 7f02e7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:34.137 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T07:54:34.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:34.258+0000 7f4959f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:34.266+0000 7f4959f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:34.450 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:34.450 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:54:34.463 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-16T07:54:33.871658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":251800,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":249600,"kb_avail":377235560,"statfs":{"total":386547056640,"available":386289213440,"internally_reserved":0,"allocated":2179072,"data_stored":2520865,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":255590400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.458442"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":298,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439882+0000","last_change":"2024-09-16T07:39:47.778831+0000","last_active":"2024-09-16T07:54:26.439882+0000","last_peered":"2024-09-16T07:54:26.439882+0000","last_clean":"2024-09-16T07:54:26.439882+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:54:26.439882+0000","last_undegraded":"2024-09-16T07:54:26.439882+0000","last_fullsized":"2024-09-16T07:54:26.439882+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:46.710014+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":230,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439090+0000","last_change":"2024-09-16T07:39:50.757176+0000","last_active":"2024-09-16T07:54:26.439090+0000","last_peered":"2024-09-16T07:54:26.439090+0000","last_clean":"2024-09-16T07:54:26.439090+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:54:26.439090+0000","last_undegraded":"2024-09-16T07:54:26.439090+0000","last_fullsized":"2024-09-16T07:54:26.439090+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.437124+0000","last_change":"2024-09-16T07:39:50.755413+0000","last_active":"2024-09-16T07:54:26.437124+0000","last_peered":"2024-09-16T07:54:26.437124+0000","last_clean":"2024-09-16T07:54:26.437124+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:54:26.437124+0000","last_undegraded":"2024-09-16T07:54:26.437124+0000","last_fullsized":"2024-09-16T07:54:26.437124+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439672+0000","last_change":"2024-09-16T07:39:50.754352+0000","last_active":"2024-09-16T07:54:26.439672+0000","last_peered":"2024-09-16T07:54:26.439672+0000","last_clean":"2024-09-16T07:54:26.439672+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:54:26.439672+0000","last_undegraded":"2024-09-16T07:54:26.439672+0000","last_fullsized":"2024-09-16T07:54:26.439672+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.439036+0000","last_change":"2024-09-16T07:39:50.757219+0000","last_active":"2024-09-16T07:54:26.439036+0000","last_peered":"2024-09-16T07:54:26.439036+0000","last_clean":"2024-09-16T07:54:26.439036+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:54:26.439036+0000","last_undegraded":"2024-09-16T07:54:26.439036+0000","last_fullsized":"2024-09-16T07:54:26.439036+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442212+0000","last_change":"2024-09-16T07:39:50.758469+0000","last_active":"2024-09-16T07:54:26.442212+0000","last_peered":"2024-09-16T07:54:26.442212+0000","last_clean":"2024-09-16T07:54:26.442212+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:54:26.442212+0000","last_undegraded":"2024-09-16T07:54:26.442212+0000","last_fullsized":"2024-09-16T07:54:26.442212+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.442646+0000","last_change":"2024-09-16T07:39:50.758756+0000","last_active":"2024-09-16T07:54:26.442646+0000","last_peered":"2024-09-16T07:54:26.442646+0000","last_clean":"2024-09-16T07:54:26.442646+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:54:26.442646+0000","last_undegraded":"2024-09-16T07:54:26.442646+0000","last_fullsized":"2024-09-16T07:54:26.442646+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.438475+0000","last_change":"2024-09-16T07:39:50.753604+0000","last_active":"2024-09-16T07:54:26.438475+0000","last_peered":"2024-09-16T07:54:26.438475+0000","last_clean":"2024-09-16T07:54:26.438475+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:54:26.438475+0000","last_undegraded":"2024-09-16T07:54:26.438475+0000","last_fullsized":"2024-09-16T07:54:26.438475+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:26.436649+0000","last_change":"2024-09-16T07:39:50.754321+0000","last_active":"2024-09-16T07:54:26.436649+0000","last_peered":"2024-09-16T07:54:26.436649+0000","last_clean":"2024-09-16T07:54:26.436649+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:54:26.436649+0000","last_undegraded":"2024-09-16T07:54:26.436649+0000","last_fullsized":"2024-09-16T07:54:26.436649+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:39:47.713746+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28792,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":28288,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":499712,"data_stored":187445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28966912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60220,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":59648,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":61079552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125940,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245900,"statfs":{"total":96636764160,"available":96507801600,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36848,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":36288,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":557056,"data_stored":777794,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":37158912},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:34.468 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T07:39:46.710014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=46, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.468 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T07:39:47.713746+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.468 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T07:39:47.713746+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.468 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T07:39:47.713746+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.468 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T07:39:47.713746+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.468 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T07:39:47.713746+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.468 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T07:39:47.713746+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.469 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-16T07:39:47.713746+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.469 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T07:39:47.713746+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=39, tm_sec=47, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=7, tm_min=54, tm_sec=31, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T07:54:34.469 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T07:54:54.470 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T07:54:54.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:54.589+0000 7f5237511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:54.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:54.597+0000 7f5237511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:54.782 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-09-16T07:54:54.782 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-09-16T07:54:54.795 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":532,"stamp":"2024-09-16T07:54:53.876269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":251800,"kb_used_data":2128,"kb_used_omap":0,"kb_used_meta":249600,"kb_avail":377235560,"statfs":{"total":386547056640,"available":386289213440,"internally_reserved":0,"allocated":2179072,"data_stored":2520865,"data_compressed":90111,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":255590400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002722"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":300,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.213267+0000","last_change":"2024-09-16T07:54:33.239065+0000","last_active":"2024-09-16T07:54:33.213267+0000","last_peered":"2024-09-16T07:54:33.213267+0000","last_clean":"2024-09-16T07:54:33.213267+0000","last_became_active":"2024-09-16T07:39:47.765324+0000","last_became_peered":"2024-09-16T07:39:47.765324+0000","last_unstale":"2024-09-16T07:54:33.213267+0000","last_undegraded":"2024-09-16T07:54:33.213267+0000","last_fullsized":"2024-09-16T07:54:33.213267+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-16T07:54:33.238853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:33.238853+0000","last_clean_scrub_stamp":"2024-09-16T07:39:46.710014+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"12'1","reported_seq":232,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:34.144064+0000","last_change":"2024-09-16T07:54:34.195640+0000","last_active":"2024-09-16T07:54:34.144064+0000","last_peered":"2024-09-16T07:54:34.144064+0000","last_clean":"2024-09-16T07:54:34.144064+0000","last_became_active":"2024-09-16T07:39:48.821923+0000","last_became_peered":"2024-09-16T07:39:48.821923+0000","last_unstale":"2024-09-16T07:54:34.144064+0000","last_undegraded":"2024-09-16T07:54:34.144064+0000","last_fullsized":"2024-09-16T07:54:34.144064+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-16T07:54:34.195441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:34.195441+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:34.141978+0000","last_change":"2024-09-16T07:54:34.160799+0000","last_active":"2024-09-16T07:54:34.141978+0000","last_peered":"2024-09-16T07:54:34.141978+0000","last_clean":"2024-09-16T07:54:34.141978+0000","last_became_active":"2024-09-16T07:39:48.795525+0000","last_became_peered":"2024-09-16T07:39:48.795525+0000","last_unstale":"2024-09-16T07:54:34.141978+0000","last_undegraded":"2024-09-16T07:54:34.141978+0000","last_fullsized":"2024-09-16T07:54:34.141978+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:34.160489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:34.160489+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.678817+0000","last_change":"2024-09-16T07:54:33.692314+0000","last_active":"2024-09-16T07:54:33.678817+0000","last_peered":"2024-09-16T07:54:33.678817+0000","last_clean":"2024-09-16T07:54:33.678817+0000","last_became_active":"2024-09-16T07:39:48.830806+0000","last_became_peered":"2024-09-16T07:39:48.830806+0000","last_unstale":"2024-09-16T07:54:33.678817+0000","last_undegraded":"2024-09-16T07:54:33.678817+0000","last_fullsized":"2024-09-16T07:54:33.678817+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:33.692109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:33.692109+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"14'2","reported_seq":233,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:34.144050+0000","last_change":"2024-09-16T07:54:34.166140+0000","last_active":"2024-09-16T07:54:34.144050+0000","last_peered":"2024-09-16T07:54:34.144050+0000","last_clean":"2024-09-16T07:54:34.144050+0000","last_became_active":"2024-09-16T07:39:48.826210+0000","last_became_peered":"2024-09-16T07:39:48.826210+0000","last_unstale":"2024-09-16T07:54:34.144050+0000","last_undegraded":"2024-09-16T07:54:34.144050+0000","last_fullsized":"2024-09-16T07:54:34.144050+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-16T07:54:34.165891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:34.165891+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.215074+0000","last_change":"2024-09-16T07:54:33.235944+0000","last_active":"2024-09-16T07:54:33.215074+0000","last_peered":"2024-09-16T07:54:33.215074+0000","last_clean":"2024-09-16T07:54:33.215074+0000","last_became_active":"2024-09-16T07:39:48.831281+0000","last_became_peered":"2024-09-16T07:39:48.831281+0000","last_unstale":"2024-09-16T07:54:33.215074+0000","last_undegraded":"2024-09-16T07:54:33.215074+0000","last_fullsized":"2024-09-16T07:54:33.215074+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:33.235685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:33.235685+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.215628+0000","last_change":"2024-09-16T07:54:33.236890+0000","last_active":"2024-09-16T07:54:33.215628+0000","last_peered":"2024-09-16T07:54:33.215628+0000","last_clean":"2024-09-16T07:54:33.215628+0000","last_became_active":"2024-09-16T07:39:48.812653+0000","last_became_peered":"2024-09-16T07:39:48.812653+0000","last_unstale":"2024-09-16T07:54:33.215628+0000","last_undegraded":"2024-09-16T07:54:33.215628+0000","last_fullsized":"2024-09-16T07:54:33.215628+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:33.236732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:33.236732+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:33.214585+0000","last_change":"2024-09-16T07:54:33.229371+0000","last_active":"2024-09-16T07:54:33.214585+0000","last_peered":"2024-09-16T07:54:33.214585+0000","last_clean":"2024-09-16T07:54:33.214585+0000","last_became_active":"2024-09-16T07:39:48.786638+0000","last_became_peered":"2024-09-16T07:39:48.786638+0000","last_unstale":"2024-09-16T07:54:33.214585+0000","last_undegraded":"2024-09-16T07:54:33.214585+0000","last_fullsized":"2024-09-16T07:54:33.214585+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:33.229179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:33.229179+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":231,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-16T07:54:34.143719+0000","last_change":"2024-09-16T07:54:34.188673+0000","last_active":"2024-09-16T07:54:34.143719+0000","last_peered":"2024-09-16T07:54:34.143719+0000","last_clean":"2024-09-16T07:54:34.143719+0000","last_became_active":"2024-09-16T07:39:48.804602+0000","last_became_peered":"2024-09-16T07:39:48.804602+0000","last_unstale":"2024-09-16T07:54:34.143719+0000","last_undegraded":"2024-09-16T07:54:34.143719+0000","last_fullsized":"2024-09-16T07:54:34.143719+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T07:54:34.188492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T07:54:34.188492+0000","last_clean_scrub_stamp":"2024-09-16T07:39:47.713746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28792,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":28288,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":499712,"data_stored":187445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28966912},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60220,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":59648,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":61079552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125940,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94245900,"statfs":{"total":96636764160,"available":96507801600,"internally_reserved":0,"allocated":561152,"data_stored":777813,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36848,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":36288,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":557056,"data_stored":777794,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":37158912},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30037,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T07:54:54.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T07:54:54.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:54.898+0000 7fed790b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:54.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-09-16T07:54:54.909+0000 7fed790b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-16T07:54:55.114 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T07:54:55.115 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T07:54:55.115 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T07:54:55.115 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:54:55.200 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T07:54:55.201 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T07:54:55.201 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:54:55.291 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T07:54:55.291 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T07:54:55.292 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:54:55.374 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T07:54:55.374 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T07:54:55.374 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:54:55.447 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T07:54:55.447 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T07:54:55.448 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T07:54:55.448 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:54:55.476 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T07:54:55.477 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T07:54:55.477 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T07:54:55.477 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T07:54:55.489 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T07:54:55.489 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T07:54:55.490 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-09-16T07:54:55.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T07:54:55.571 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T07:54:55.767 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T07:54:55.767 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T07:54:55.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-16T07:54:55.878 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T07:54:55.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-16T07:54:55.982 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T07:54:56.087 INFO:tasks.ceph:Archiving mon data... 2024-09-16T07:54:56.089 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867/data/mon.a.tgz 2024-09-16T07:54:56.089 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-09-16T07:54:56.105 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.Lml6mlgo03 2024-09-16T07:54:56.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Lml6mlgo03 2024-09-16T07:54:56.223 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.Lml6mlgo03 2024-09-16T07:54:56.306 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.Lml6mlgo03 is 205KB 2024-09-16T07:54:56.401 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.Lml6mlgo03 2024-09-16T07:54:56.417 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T07:54:56.417 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T07:54:56.458 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T07:54:56.537 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T07:54:56.553 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T07:54:56.553 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T07:54:56.555 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867/remote/smithi137/crash 2024-09-16T07:54:56.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T07:54:56.601 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867/remote/smithi170/crash 2024-09-16T07:54:56.602 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T07:54:56.637 INFO:tasks.ceph:Compressing logs... 2024-09-16T07:54:56.637 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T07:54:56.645 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T07:54:56.716 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28212.log 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28252.log 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr:gzip/var/log/ceph/ceph-client.admin.28212.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28292.log 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28212.log.gz 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.28252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28163.log 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28252.log.gz 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.28292.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28292.log.gz 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.28163.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28163.log.gz 2024-09-16T07:54:56.717 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T07:54:56.796 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-osd.3.log: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51484.log 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62360.log 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51404.log 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51484.log.gz 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60579.log 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62360.log.gz 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51404.log.gz 2024-09-16T07:54:56.904 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37379.log 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60579.log.gz 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.42773.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40394.log 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57813.log 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37379.log.gz 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59617.log 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40394.log.gz 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33213.log 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57813.log.gz 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42902.log 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59617.log.gz 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47383.log 2024-09-16T07:54:56.905 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33213.log.gz 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29170.log 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42902.log.gz 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.47383.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51920.log 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47383.log.gz 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29170.log.gz 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39506.log 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.51920.log.gz 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49178.log 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44975.log 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39506.log.gz 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29313.log 2024-09-16T07:54:56.906 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49178.log.gz 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58303.log 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44975.log.gz 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57862.log 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29313.log.gz 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41707.log 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58303.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58303.log.gz 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58037.log 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57862.log.gz 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58170.log 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41707.log.gz 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58037.log.gz 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59547.log 2024-09-16T07:54:56.907 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58170.log.gz 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.48782.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36794.log 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48175.log 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59547.log.gz 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47860.log 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36794.log.gz 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59309.log 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48175.log.gz 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60621.log 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47860.log.gz 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51840.log 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59309.log.gz 2024-09-16T07:54:56.908 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40794.log 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60621.log.gz 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46618.log 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51840.log.gz 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62578.log 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40794.log.gz 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55676.log 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46618.log.gz 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40136.log 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62578.log.gz 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60413.log 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55676.log.gz 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40176.log 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40136.log.gz 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49306.log 2024-09-16T07:54:56.909 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.60413.log.gz 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43438.log 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40176.log.gz 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31430.log 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49306.log.gz 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64090.log 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43438.log.gz 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32626.log 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31430.log.gz 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66840.log 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64090.log.gz 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31143.log 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32626.log.gz 2024-09-16T07:54:56.910 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29716.log 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66840.log.gz 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47156.log 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31143.log.gz 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29716.log.gz 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33333.log 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47156.log.gz 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60879.log 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30099.log 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33333.log.gz 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36242.log 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.60879.log.gz 2024-09-16T07:54:56.911 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51137.log 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30099.log.gz 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5/var/log/ceph/ceph-client.admin.36242.log: --verbose -- /var/log/ceph/ceph-client.admin.30627.log 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36242.log.gz 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65832.log 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51137.log.gz 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33471.log 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30627.log.gz 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29674.log 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65832.log.gz 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58432.log 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33471.log.gz 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53368.log 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29674.log.gz 2024-09-16T07:54:56.912 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64784.log 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58432.log.gz 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38703.log 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53368.log.gz 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54036.log 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64784.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64784.log.gz 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45157.log 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38703.log.gz 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41569.log 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54036.log.gz 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45157.log.gz 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42813.log 2024-09-16T07:54:56.913 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41569.log.gz 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59945.log 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50919.log 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42813.log.gz 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33115.log 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59945.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59945.log.gz 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51017.log 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50919.log.gz 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59358.log 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33115.log.gz 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56305.log 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51017.log.gz 2024-09-16T07:54:56.914 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57199.log 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59358.log.gz 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52850.log 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56305.log.gz 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64130.log 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57199.log.gz 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43111.log 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52850.log.gz 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32227.log 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64130.log.gz 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40745.log 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43111.log.gz 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65607.log 2024-09-16T07:54:56.915 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32227.log.gz 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35188.log 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40745.log.gz 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53437.log 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65607.log.gz 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34741.log 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35188.log.gz 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53279.log 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53437.log.gz 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.34741.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50510.log 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34741.log.gz 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59004.log 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53279.log.gz 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53508.log 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50510.log.gz 2024-09-16T07:54:56.916 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35535.log 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59004.log.gz 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36753.log 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53508.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53508.log.gz 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57724.log 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35535.log.gz 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56445.log 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36753.log.gz 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50779.log 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57724.log.gz 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36928.log 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56445.log.gz 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57337.log 2024-09-16T07:54:56.917 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50779.log.gz 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45820.log 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36928.log.gz 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54256.log 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57337.log.gz 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41489.log 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45820.log.gz 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54664.log 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54256.log.gz 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53823.log 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41489.log.gz 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66546.log 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54664.log.gz 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35753.log 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53823.log.gz 2024-09-16T07:54:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31640.log 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66546.log.gz 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42066.log 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35753.log.gz 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39179.log 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31640.log.gz 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65349.log 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42066.log.gz 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54396.log 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39179.log.gz 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49794.log 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65349.log.gz 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30278.log 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54396.log.gz 2024-09-16T07:54:56.919 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52522.log 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49794.log.gz 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30278.log.gz 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52522.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52522.log.gz 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61322.log 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43300.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59672.log 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61322.log.gz 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43823.log 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54842.log 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59672.log.gz 2024-09-16T07:54:56.920 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28946.log 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43823.log.gz 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47463.log 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54842.log.gz 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51444.log 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28946.log.gz 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62170.log 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47463.log.gz 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51444.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51444.log.gz 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30538.log 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48742.log 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.62170.log.gz 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47423.log 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30538.log.gz 2024-09-16T07:54:56.921 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60034.log 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48742.log.gz 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47423.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47423.log.gz 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46129.log 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60034.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60034.log.gz 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61565.log 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30002.log/var/log/ceph/ceph-client.admin.46129.log: 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46129.log.gz 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61565.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.61565.log.gz -5 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57506.log 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30002.log.gz 2024-09-16T07:54:56.922 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38256.log 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57506.log.gz 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46836.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49218.log 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34790.log 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38256.log.gz 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49218.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49218.log.gz 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54532.log 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56937.log 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34790.log.gz 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54532.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.54532.log.gz 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41052.log 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48920.log 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56937.log.gz 2024-09-16T07:54:56.923 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41052.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41052.log.gzgzip 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57599.log 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33812.log 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48920.log.gz 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57599.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.57599.log.gz -5 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48831.log 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33812.log: 50.0%/var/log/ceph/ceph-client.admin.45602.log: -- replaced with /var/log/ceph/ceph-client.admin.33812.log.gz 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65958.log 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65523.log 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48831.log.gz 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49972.log 2024-09-16T07:54:56.924 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65958.log.gz 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65523.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27389.log 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65523.log.gz 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41409.log 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49972.log.gz 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.tmp-client.admin.27389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34076.log 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr: 66.9% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27389.log.gz 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41409.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41409.log.gz 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30171.log 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34076.log.gz 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47065.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45513.log 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.30171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49536.log 2024-09-16T07:54:56.925 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45513.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45513.log.gz 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57924.log 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46000.log 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49536.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49536.log.gz 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51960.log 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57924.log.gz 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40652.log 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46000.log.gz 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39002.log 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51960.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51960.log.gz 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66084.log 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40652.log.gz 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.39002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35010.log 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67427.log 2024-09-16T07:54:56.926 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66084.log.gz 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54962.log 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35010.log.gz 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45771.log 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67427.log.gz 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30558.log 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54962.log.gz 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64695.log 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45771.log.gz 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64477.log 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30558.log.gz 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60203.log 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64695.log.gz 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63732.log 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64477.log.gz 2024-09-16T07:54:56.927 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32536.log 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60203.log.gz 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63732.log.gz 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32536.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.32536.log.gz 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65140.log 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47721.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.50570.log 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65140.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61775.log 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65140.log.gz 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42853.log 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50570.log.gz 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39268.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61775.log.gz 2024-09-16T07:54:56.928 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42853.log: gzip 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42853.log.gz 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60959.log 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39268.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39268.log.gz 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52724.log 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41888.log 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60959.log.gz 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.52724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36382.log 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41888.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41888.log.gz 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.59407.log 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36382.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36382.log.gz 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46796.log 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59407.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59407.log.gz 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.48475.log 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46796.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37201.log 2024-09-16T07:54:56.929 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46796.log.gz 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48880.log 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54165.log 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37201.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.37201.log.gz 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67176.log 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54165.log: /var/log/ceph/ceph-client.admin.48880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54165.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48880.log.gz 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37949.log 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67176.log.gz 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54214.log 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45115.log: /var/log/ceph/ceph-client.admin.37949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64526.log 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2024-09-16T07:54:56.930 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37949.log.gz 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59994.log 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54214.log.gz 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31192.log 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64526.log: /var/log/ceph/ceph-client.admin.59994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50550.log 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64526.log.gz 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59994.log.gz 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31192.log.gz 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59092.log 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50550.log: /var/log/ceph/ceph-client.admin.44835.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58819.log 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50550.log.gz 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2024-09-16T07:54:56.931 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34541.log 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59092.log.gz 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47254.log 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58819.log: /var/log/ceph/ceph-client.admin.34541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30498.log 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58819.log.gz 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34541.log.gz 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47254.log.gz 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57437.log 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30498.log: /var/log/ceph/ceph-client.admin.32808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53945.log 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30498.log.gz 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57437.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57437.log.gzgzip 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39059.log 2024-09-16T07:54:56.932 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36011.log 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53945.log: /var/log/ceph/ceph-client.admin.39059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57157.log 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53945.log.gz 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39059.log.gz 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36011.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36011.log.gz -5 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35139.log 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51622.log 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57157.log: /var/log/ceph/ceph-client.admin.35139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63772.log 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57157.log.gz 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35139.log.gz 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38207.log 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51622.log.gz 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58699.log 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63772.log: /var/log/ceph/ceph-client.admin.38207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61408.log 2024-09-16T07:54:56.933 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63772.log.gz 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38207.log.gz 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64575.log 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58699.log.gz 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32766.log 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61408.log: /var/log/ceph/ceph-client.admin.64575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64437.log 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61408.log.gz 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64575.log.gz 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32766.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32766.log.gz 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39219.log 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42284.log 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64437.log: /var/log/ceph/ceph-client.admin.39219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32451.log 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64437.log.gz 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39219.log.gz 2024-09-16T07:54:56.934 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42284.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42284.log.gz -5 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57764.log 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34520.log 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32451.log: /var/log/ceph/ceph-client.admin.57764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53996.log 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32451.log.gz 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57764.log.gz 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58352.log 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34520.log.gz 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55459.log 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53996.log: /var/log/ceph/ceph-client.admin.58352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63245.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58352.log.gz 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55459.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53996.log.gz 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55459.log.gz 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54116.log 2024-09-16T07:54:56.935 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65300.log 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63245.log: /var/log/ceph/ceph-client.admin.54116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62927.log 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54116.log.gz 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63245.log.gz 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65300.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65300.log.gz 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36340.log 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62927.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62927.log.gz 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61097.log 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36340.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36340.log.gz 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.56075.log 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61097.log: 49.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44479.log 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61097.log.gz 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41271.log 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56075.log.gz 2024-09-16T07:54:56.936 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57248.log 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44479.log: /var/log/ceph/ceph-client.admin.41271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40296.log 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44479.log.gz 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41271.log.gz 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57248.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57248.log.gz 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46349.log 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38345.log 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40296.log: /var/log/ceph/ceph-client.admin.46349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66435.log 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40296.log.gz 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46349.log.gz 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38345.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38345.log.gz 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34116.log 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32946.log 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66435.log: /var/log/ceph/ceph-client.admin.34116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44221.log 2024-09-16T07:54:56.937 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66435.log.gz 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34116.log.gz 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32946.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32946.log.gz 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36571.log 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55717.log 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44221.log: /var/log/ceph/ceph-client.admin.36571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67260.log 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44221.log.gz 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36571.log.gz 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55717.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35962.log 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55717.log.gz 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62887.log 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.67260.log.gz 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31382.log 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35962.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.62887.log: -- /var/log/ceph/ceph-client.admin.32906.log 2024-09-16T07:54:56.938 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62887.log.gz 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35962.log.gz 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31382.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31382.log.gz 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56634.log 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60661.log 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32906.log: /var/log/ceph/ceph-client.admin.56634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32906.log.gz 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56634.log.gz 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60661.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60661.log.gz 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35655.log 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51742.log 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32857.log: /var/log/ceph/ceph-client.admin.35655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52267.log 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35655.log.gz 2024-09-16T07:54:56.939 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36620.log 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51742.log.gz 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52267.log: /var/log/ceph/ceph-client.admin.36620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35495.log 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.52267.log.gz 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36620.log.gz 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59449.log 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55319.log 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35495.log: /var/log/ceph/ceph-client.admin.59449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64958.log 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35495.log.gz 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59449.log.gz 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54922.log 2024-09-16T07:54:56.940 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55319.log.gz 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55766.log 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64958.log: /var/log/ceph/ceph-client.admin.54922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53159.log 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64958.log.gz 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54922.log.gz 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66042.log 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55766.log.gz 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58254.log 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53159.log: gzip/var/log/ceph/ceph-client.admin.66042.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66756.log 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66042.log.gz 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0%/var/log/ceph/ceph-client.admin.58254.log: -- replaced with /var/log/ceph/ceph-client.admin.53159.log.gz 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.58254.log.gz 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42406.log 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66756.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66756.log.gz 2024-09-16T07:54:56.941 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44926.log 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42406.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42406.log.gz 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44926.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44926.log.gz 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62440.log 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45682.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52970.log 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62440.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62440.log.gz 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43914.log 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52970.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52970.log.gz 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47952.log 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43914.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43914.log.gz 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48573.log 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47952.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53319.log 2024-09-16T07:54:56.942 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47952.log.gz 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64655.log 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48573.log.gz 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47561.log 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53319.log: /var/log/ceph/ceph-client.admin.64655.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53319.log.gz 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63821.log 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64655.log.gz 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55082.log 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47561.log.gz 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44390.log 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63821.log: /var/log/ceph/ceph-client.admin.55082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64397.log 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55082.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63821.log.gz 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44390.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44390.log.gz 2024-09-16T07:54:56.943 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46569.log 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46925.log 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64397.log: /var/log/ceph/ceph-client.admin.46569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65438.log 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64397.log.gz 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46569.log.gz 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62320.log 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46925.log.gz 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64735.log 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65438.log: /var/log/ceph/ceph-client.admin.62320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44528.log 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr: 47.2% -- replaced with /var/log/ceph/ceph-client.admin.65438.log.gz 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62320.log.gz 2024-09-16T07:54:56.944 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64735.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64735.log.gz 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62738.log 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44528.log: /var/log/ceph/ceph-client.admin.62738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41122.log 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44528.log.gz 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62738.log.gz 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38127.log 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60074.log 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41122.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41122.log.gz 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38127.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38127.log.gz 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31242.log 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60074.log: /var/log/ceph/ceph-client.admin.38654.log: 49.6% 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T07:54:56.945 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60074.log.gz 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33680.log 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44568.log 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31242.log.gz 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33680.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33680.log.gz 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66269.log 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44568.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44568.log.gz 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34336.log 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66269.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30369.log 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66269.log.gz 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35704.log 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34336.log.gz 2024-09-16T07:54:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35233.log 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30369.log: /var/log/ceph/ceph-client.admin.35704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40002.log 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30369.log.gz 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35704.log.gz 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55060.log 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35233.log.gz 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48126.log 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40002.log: /var/log/ceph/ceph-client.admin.55060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64833.log 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40002.log.gz 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55060.log.gz 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59854.log 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48126.log.gz 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49745.log 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64833.log: /var/log/ceph/ceph-client.admin.59854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48069.log 2024-09-16T07:54:56.947 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64833.log.gz 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59854.log.gz 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49487.log 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49745.log.gz 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30885.log 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.48069.log: /var/log/ceph/ceph-client.admin.49487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49487.log.gz 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30885.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30885.log.gz 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41618.log 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65874.log 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41618.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41618.log.gz 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65398.log 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62082.log 2024-09-16T07:54:56.948 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65874.log.gz 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65398.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65398.log.gz 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38752.log 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30983.log 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62082.log.gz 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38752.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38752.log.gz 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34692.log 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48395.log 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30983.log.gz 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34692.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34692.log.gz 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29312.log 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61635.log 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48395.log.gz 2024-09-16T07:54:56.949 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29312.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29312.log.gz 2024-09-16T07:54:56.950 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65697.log 2024-09-16T07:54:56.950 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58739.log 2024-09-16T07:54:56.950 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61635.log.gz 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65697.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65697.log.gz 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29314.log 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47997.log 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58739.log.gz 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29314.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29314.log.gz 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44172.log 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41787.log 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47997.log.gz 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44172.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44172.log.gz 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29590.log 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48656.log 2024-09-16T07:54:56.953 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41787.log.gz 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29590.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29590.log.gz 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36291.log 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61873.log 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48656.log.gz 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36291.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36291.log.gz 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60392.log 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61873.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61873.log.gz 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59587.log 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37907.log 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60392.log.gz 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59587.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59587.log.gz 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57904.log 2024-09-16T07:54:56.954 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36480.log 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37907.log.gz 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57904.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57904.log.gz 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35397.log 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39848.log 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36480.log.gz 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35397.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35397.log.gz 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52613.log 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42991.log 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39848.log.gz 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52613.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52613.log.gz 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58392.log 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39646.log 2024-09-16T07:54:56.955 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42991.log.gz 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56035.log 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58392.log.gz 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47641.log 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39646.log.gz 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56035.log.gz 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47641.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29128.log 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47641.log.gz 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49445.log 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29128.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.29128.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.55137.log 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38087.log 2024-09-16T07:54:56.956 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49445.log.gz 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55137.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55137.log.gz 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41529.log 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50737.log 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38087.log.gz 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41529.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41529.log.gz 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47681.log 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60839.log 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50737.log.gz 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47681.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47681.log.gz 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31551.log 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41747.log 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60839.log.gz 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31551.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31551.log.gz 2024-09-16T07:54:56.957 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31780.log 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67302.log 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41747.log.gz 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31780.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31780.log.gz 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50688.log 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39099.log 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67302.log.gz 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50688.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50688.log.gz 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39358.log 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39099.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39099.log.gz 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32584.log 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39358.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49089.log 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39358.log.gz 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59756.log 2024-09-16T07:54:56.958 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32584.log.gz 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49089.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49089.log.gz 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61824.log 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32668.log 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59756.log.gz 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61824.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61824.log.gz 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49238.log 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51791.log 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32668.log.gz 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49238.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.49238.log.gz 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57995.log 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54624.log 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51791.log.gz 2024-09-16T07:54:56.959 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57995.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57995.log.gz 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60790.log 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40094.log 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54624.log.gz 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60790.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60790.log.gz 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40701.log 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35575.log 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40094.log.gz 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40701.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40701.log.gz 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53648.log 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38563.log 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35575.log.gz 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53648.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.53648.log.gz 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63514.log 2024-09-16T07:54:56.960 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46876.log 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63514.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63514.log.gz 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38305.log 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.46876.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39317.log 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46876.log.gz 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38305.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38305.log.gz 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42326.log 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61993.log 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39317.log.gz 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42326.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42326.log.gz 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31282.log 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46308.log 2024-09-16T07:54:56.961 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61993.log.gz 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31282.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31282.log.gz 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43766.log 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66606.log 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46308.log.gz 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.43766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64268.log 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66606.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66606.log.gz 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66268.log 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64268.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64268.log.gz 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62271.log 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66268.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66268.log.gz 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36102.log 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62271.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62271.log.gz 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33075.log 2024-09-16T07:54:56.962 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36102.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36102.log.gz 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49585.log 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33075.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33075.log.gz 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49585.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49585.log.gz 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62033.log 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35274.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gz 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52227.log 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62033.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62033.log.gz 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39408.log 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52227.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52227.log.gz 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54446.log 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39408.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39408.log.gz 2024-09-16T07:54:56.963 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33898.log 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54446.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54446.log.gz 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54882.log 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33898.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33898.log.gz 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61913.log 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54882.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54882.log.gz 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62844.log 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61913.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61913.log.gz 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38167.log 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62844.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62844.log.gz 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48217.log 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38167.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38167.log.gz 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54076.log 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48217.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48217.log.gz 2024-09-16T07:54:56.964 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52397.log 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54076.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54076.log.gz 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57297.log 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52397.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.52397.log.gz 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56213.log 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57297.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57297.log.gz 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44697.log 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56213.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56213.log.gz 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46478.log 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44697.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44697.log.gz 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56897.log 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46478.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46478.log.gz 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66605.log 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56897.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.56897.log.gz 2024-09-16T07:54:56.965 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66605.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.66605.log.gz 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34434.log 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49000.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31731.log 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34434.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34434.log.gz 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58472.log 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31731.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31731.log.gz 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38610.log 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58472.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58472.log.gz 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62976.log 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38610.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38610.log.gz 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43229.log 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62976.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62976.log.gz 2024-09-16T07:54:56.966 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30320.log 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43229.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43229.log.gz 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30320.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30320.log.gz 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53905.log 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50639.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52572.log 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53905.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53905.log.gz 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40454.log 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52572.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52572.log.gz 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40843.log 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40454.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40454.log.gz 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37061.log 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40843.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40843.log.gz 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2024-09-16T07:54:56.967 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37061.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37061.log.gz 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66882.log 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39786.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44590.log 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66882.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66882.log.gz 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59050.log 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44590.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44590.log.gz 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33987.log 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59050.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59050.log.gz 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58653.log 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33987.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33987.log.gz 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63285.log 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58653.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.58653.log.gz 2024-09-16T07:54:56.968 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66798.log 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63285.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63285.log.gz 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48266.log 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66798.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66798.log.gz 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35615.log 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48266.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48266.log.gz 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33422.log 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35615.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35615.log.gz 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50052.log 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33422.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33422.log.gz 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48038.log 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50052.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50052.log.gz 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39688.log 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48038.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48038.log.gz 2024-09-16T07:54:56.969 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39688.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39688.log.gz 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35773.log 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43600.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67387.log 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35773.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35773.log.gz 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59267.log 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67387.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67387.log.gz 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59896.log 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59267.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59267.log.gz 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29482.log 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59896.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59896.log.gz 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56115.log 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29482.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29482.log.gz 2024-09-16T07:54:56.970 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42455.log 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56115.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56115.log.gz 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34930.log 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42455.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42455.log.gz 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49396.log 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34930.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34930.log.gz 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31023.log 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49396.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49396.log.gz 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37690.log 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31023.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31023.log.gz 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53019.log 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37690.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37690.log.gz 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60999.log 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53019.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.53019.log.gz 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43694.log 2024-09-16T07:54:56.971 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60999.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60999.log.gz 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29002.log 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43694.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43694.log.gz 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31871.log 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29002.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29002.log.gz 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65790.log 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31871.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31871.log.gz 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37599.log 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65790.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65790.log.gz 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64050.log 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37599.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37599.log.gz 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36431.log 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64050.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64050.log.gz 2024-09-16T07:54:56.972 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52830.log 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36431.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36431.log.gz 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52492.log 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52830.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52830.log.gz 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53557.log 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52492.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52492.log.gz 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51880.log 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53557.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53557.log.gz 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67050.log 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51880.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51880.log.gz 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30001.log 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67050.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67050.log.gz 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67008.log 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30001.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30001.log.gz 2024-09-16T07:54:56.973 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61544.log 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67008.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67008.log.gz 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47512.log 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61544.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61544.log.gz 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35357.log 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47512.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47512.log.gz 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62529.log 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35357.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35357.log.gz 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65180.log 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62529.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62529.log.gz 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46752.log 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65180.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65180.log.gz 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46752.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46752.log.gz 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35050.log 2024-09-16T07:54:56.974 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45722.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65260.log 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35050.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35050.log.gz 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65747.log 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65260.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65260.log.gz 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50470.log 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65747.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65747.log.gz 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65220.log 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50470.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50470.log.gz 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59183.log 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65220.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65220.log.gz 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59805.log 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59183.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.59183.log.gz 2024-09-16T07:54:56.975 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53781.log 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59805.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59805.log.gz 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60252.log 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53781.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.53781.log.gz 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28532.log 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60252.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60252.log.gz 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42106.log 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28532.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28532.log.gz 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41808.log 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42106.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42106.log.gz 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41808.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41808.log.gz 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66714.log 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44092.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2024-09-16T07:54:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66438.log 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66714.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66714.log.gz 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63025.log 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66438.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66438.log.gz 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47908.log 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63025.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63025.log.gz 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34832.log 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47908.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47908.log.gz 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50012.log 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34832.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34832.log.gz 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45295.log 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50012.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54753.log 2024-09-16T07:54:56.977 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45295.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45295.log.gz 2024-09-16T07:54:56.985 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49040.log 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54753.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.54753.log.gz 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41937.log 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49040.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49040.log.gz 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58492.log 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41937.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41937.log.gz 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58610.log 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58492.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58492.log.gz 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57051.log 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58610.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58610.log.gz 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62222.log 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.57051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33858.log 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62222.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62222.log.gz 2024-09-16T07:54:56.986 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55608.log 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33858.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33858.log.gz 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47819.log 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55608.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55608.log.gz 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32276.log 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33373.log 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32276.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47819.log.gz 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42195.log 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33373.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33373.log.gz 2024-09-16T07:54:56.987 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32276.log.gz 2024-09-16T07:54:56.991 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39737.log 2024-09-16T07:54:56.991 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42195.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42195.log.gz 2024-09-16T07:54:57.000 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55269.log 2024-09-16T07:54:57.013 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39737.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39737.log.gz 2024-09-16T07:54:57.014 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50968.log 2024-09-16T07:54:57.014 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55269.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55269.log.gz 2024-09-16T07:54:57.023 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T07:54:57.029 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50968.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50968.log.gz 2024-09-16T07:54:57.041 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59132.log 2024-09-16T07:54:57.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49843.log 2024-09-16T07:54:57.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59132.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59132.log.gz 2024-09-16T07:54:57.062 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33035.log 2024-09-16T07:54:57.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49843.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49843.log.gz 2024-09-16T07:54:57.074 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40923.log 2024-09-16T07:54:57.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33035.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33035.log.gz 2024-09-16T07:54:57.085 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46089.log 2024-09-16T07:54:57.086 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40923.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40923.log.gz 2024-09-16T07:54:57.104 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39597.log 2024-09-16T07:54:57.104 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46089.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46089.log.gz 2024-09-16T07:54:57.112 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35837.log 2024-09-16T07:54:57.113 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39597.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39597.log.gz 2024-09-16T07:54:57.130 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66270.log 2024-09-16T07:54:57.130 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35837.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35837.log.gz 2024-09-16T07:54:57.138 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 2024-09-16T07:54:57.139 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66270.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66270.log.gz 2024-09-16T07:54:57.158 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 2024-09-16T07:54:57.158 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41229.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2024-09-16T07:54:57.162 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34294.log 2024-09-16T07:54:57.163 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42664.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2024-09-16T07:54:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57555.log 2024-09-16T07:54:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34294.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34294.log.gz 2024-09-16T07:54:57.193 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31969.log 2024-09-16T07:54:57.193 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57555.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57555.log.gz 2024-09-16T07:54:57.206 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65002.log 2024-09-16T07:54:57.206 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31969.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31969.log.gz 2024-09-16T07:54:57.215 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59716.log 2024-09-16T07:54:57.215 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65002.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65002.log.gz 2024-09-16T07:54:57.230 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40434.log 2024-09-16T07:54:57.230 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59716.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59716.log.gz 2024-09-16T07:54:57.240 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29086.log 2024-09-16T07:54:57.240 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40434.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40434.log.gz 2024-09-16T07:54:57.257 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2024-09-16T07:54:57.258 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29086.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29086.log.gz 2024-09-16T07:54:57.266 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32138.log 2024-09-16T07:54:57.266 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43558.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2024-09-16T07:54:57.285 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42244.log 2024-09-16T07:54:57.285 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32138.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32138.log.gz 2024-09-16T07:54:57.299 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53865.log 2024-09-16T07:54:57.299 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42244.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42244.log.gz 2024-09-16T07:54:57.309 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32987.log 2024-09-16T07:54:57.309 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53865.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53865.log.gz 2024-09-16T07:54:57.315 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35922.log 2024-09-16T07:54:57.316 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32987.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32987.log.gz 2024-09-16T07:54:57.325 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29442.log 2024-09-16T07:54:57.325 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35922.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35922.log.gz 2024-09-16T07:54:57.329 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.39002.log.gz 2024-09-16T07:54:57.338 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36711.log 2024-09-16T07:54:57.339 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29442.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29442.log.gz 2024-09-16T07:54:57.366 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29481.log 2024-09-16T07:54:57.366 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36711.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36711.log.gz 2024-09-16T07:54:57.371 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33253.log 2024-09-16T07:54:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41980.log 2024-09-16T07:54:57.381 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33253.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.33253.log.gz 2024-09-16T07:54:57.384 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29481.log.gz 2024-09-16T07:54:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2024-09-16T07:54:57.390 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41980.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41980.log.gz 2024-09-16T07:54:57.399 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46046.log 2024-09-16T07:54:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46218.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34611.log 2024-09-16T07:54:57.411 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46046.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46046.log.gz 2024-09-16T07:54:57.412 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2024-09-16T07:54:57.419 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50192.log 2024-09-16T07:54:57.432 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34611.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34611.log.gz 2024-09-16T07:54:57.437 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37732.log 2024-09-16T07:54:57.437 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50192.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50192.log.gz 2024-09-16T07:54:57.441 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.48069.log.gz 2024-09-16T07:54:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45862.log 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37732.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37732.log.gz 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55955.log 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45862.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45862.log.gz 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.30171.log.gz 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43640.log 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35317.log 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55955.log.gz 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60701.log 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35317.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43640.log.gz 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.35317.log.gz 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56403.log 2024-09-16T07:54:57.617 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60701.log: -- /var/log/ceph/ceph-client.admin.31103.log 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60701.log.gz 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63563.log 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31103.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56403.log.gz 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31103.log.gz 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56725.log 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.63563.log: /var/log/ceph/ceph-client.admin.50150.log 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63563.log.gz 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43071.log 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50150.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56725.log.gz 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50150.log.gz 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57021.log 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43071.log: /var/log/ceph/ceph-client.admin.40052.log 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2024-09-16T07:54:57.618 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40563.log 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57021.log.gz 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60483.log 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40563.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40052.log.gz 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40563.log.gz 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60483.log: -- /var/log/ceph/ceph-client.admin.36886.log 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60483.log.gz 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65916.log 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46389.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30759.log 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36886.log.gz 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65916.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65916.log.gz 2024-09-16T07:54:57.619 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50241.log 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29027.log 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30759.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30759.log.gz 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50241.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50241.log.gz 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51702.log 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29027.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.29027.log.gz 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46974.log 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51702.log: -- /var/log/ceph/ceph-client.admin.58779.log 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51702.log.gz 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40216.log 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58779.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46974.log.gz 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58779.log.gz 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34970.log 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40216.log: -- /var/log/ceph/ceph-client.admin.29842.log 2024-09-16T07:54:57.620 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40216.log.gz 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39548.log 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6%/var/log/ceph/ceph-client.admin.29842.log: -- replaced with /var/log/ceph/ceph-client.admin.34970.log.gz 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29842.log.gz 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34156.log 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32029.log 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39548.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39548.log.gz 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34156.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39919.log 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34156.log.gz 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32029.log.gz 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30141.log 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39919.log.gz/var/log/ceph/ceph-client.admin.45911.log: 2024-09-16T07:54:57.621 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36200.log 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61495.log 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30141.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30141.log.gz 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36200.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36200.log.gz 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64219.log 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47114.log 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64219.log: /var/log/ceph/ceph-client.admin.61495.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61495.log.gz 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64219.log.gz 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51157.log 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47114.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47114.log.gz 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51157.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51157.log.gz 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41667.log 2024-09-16T07:54:57.622 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52049.log 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41667.log: /var/log/ceph/ceph-client.admin.49625.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41667.log.gz 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30418.log 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.52049.log: -- /var/log/ceph/ceph-client.admin.45017.log 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52049.log.gz 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37299.log 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45017.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30418.log.gz 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45017.log.gz 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43209.log 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.37299.log: -- /var/log/ceph/ceph-client.admin.43160.log 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37299.log.gz 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37823.log 2024-09-16T07:54:57.623 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43160.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43209.log.gz 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43160.log.gz 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29758.log 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37823.log: /var/log/ceph/ceph-client.admin.44270.log 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37823.log.gz 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62799.log 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44270.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29758.log.gz 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44270.log.gz 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37012.log 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64915.log 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62799.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62799.log.gz 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37012.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37012.log.gz 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57377.log 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66436.log 2024-09-16T07:54:57.624 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57377.log: /var/log/ceph/ceph-client.admin.64915.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64915.log.gz 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57377.log.gz 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57684.log 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53731.log 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66436.log: 50.0%/var/log/ceph/ceph-client.admin.57684.log: -- replaced with /var/log/ceph/ceph-client.admin.66436.log.gz 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57684.log.gz 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65460.log 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53731.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53731.log.gz 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48702.log 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67218.log 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48702.log: /var/log/ceph/ceph-client.admin.65460.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65460.log.gz 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48702.log.gz 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60741.log 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40963.log 2024-09-16T07:54:57.625 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67218.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67218.log.gz 2024-09-16T07:54:57.626 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60741.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.60741.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.46169.log 2024-09-16T07:54:57.626 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:57.626 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55588.log 2024-09-16T07:54:57.626 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.43766.log.gz 2024-09-16T07:54:57.626 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40963.log: /var/log/ceph/ceph-client.admin.46169.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40963.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46169.log.gz 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66126.log 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55588.log: gzip 49.2% -- replaced with /var/log/ceph/ceph-client.admin.55588.log.gz 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56979.log 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66126.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66126.log.gz 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32178.log 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56979.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56979.log.gz 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37459.log 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55368.log 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32178.log.gz 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37459.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63961.log 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37459.log.gz 2024-09-16T07:54:57.627 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57417.log 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55368.log.gz 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38836.log 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63961.log.gz 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65656.log 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57417.log.gz 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38836.log: /var/log/ceph/ceph-client.admin.65656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47601.log 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65656.log.gz -- replaced with /var/log/ceph/ceph-client.admin.38836.log.gz 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53239.log 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44310.log 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47601.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47601.log.gz 2024-09-16T07:54:57.628 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53239.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53239.log.gz 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43398.log 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31920.log 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44310.log: /var/log/ceph/ceph-client.admin.43398.log: 49.6%gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43398.log.gz 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.43459.log 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44310.log.gz 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31920.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31920.log.gz 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52653.log 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58958.log 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43459.log: gzip/var/log/ceph/ceph-client.admin.52653.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37250.log 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43459.log.gz 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52653.log.gz 2024-09-16T07:54:57.629 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49924.log 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58958.log.gz/var/log/ceph/ceph-client.admin.37250.log: 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37250.log.gz 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37998.log 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49924.log: /var/log/ceph/ceph-client.admin.43349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42366.log 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49924.log.gz 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37998.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45206.log 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37998.log.gz 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49864.log 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42366.log.gz 2024-09-16T07:54:57.630 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31063.log 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45206.log: /var/log/ceph/ceph-client.admin.49864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63870.log 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45206.log.gz 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49864.log.gz 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31063.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31063.log.gz 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67134.log 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55011.log 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63870.log: /var/log/ceph/ceph-client.admin.67134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62131.log 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63870.log.gz 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67134.log.gz 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55011.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55011.log.gz 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52098.log 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63463.log 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62718.log 2024-09-16T07:54:57.631 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52098.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62131.log.gz 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52098.log.gz 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50290.log 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63463.log: /var/log/ceph/ceph-client.admin.62718.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63463.log.gz 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58078.log 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62718.log.gz 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62620.log 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50290.log: /var/log/ceph/ceph-client.admin.58078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49138.log 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58078.log.gz 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50290.log.gz 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62620.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62620.log.gz 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52001.log 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49138.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49138.log.gz 2024-09-16T07:54:57.632 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33770.log 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52001.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52001.log.gz 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43518.log 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33770.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46687.log 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33770.log.gz 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41003.log 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43518.log.gz 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65567.log 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46687.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46687.log.gz 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30458.log 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41003.log: /var/log/ceph/ceph-client.admin.65567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33164.log 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41003.log.gz 2024-09-16T07:54:57.633 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65567.log.gz 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30458.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30458.log.gz 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46267.log 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37508.log 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33164.log: /var/log/ceph/ceph-client.admin.46267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34881.log 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.33164.log.gz 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46267.log.gz 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37508.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37508.log.gz/var/log/ceph/ceph-client.admin.34881.log: gzip 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58868.log 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34881.log.gz 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51226.log 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33632.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2024-09-16T07:54:57.634 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58868.log: /var/log/ceph/ceph-client.admin.51226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63374.log 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58868.log.gz 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51226.log.gz 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30803.log 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50101.log 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63374.log: /var/log/ceph/ceph-client.admin.30803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51097.log 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63374.log.gz 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30803.log.gz 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63912.log 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50101.log.gz 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44649.log 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51097.log: /var/log/ceph/ceph-client.admin.63912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63116.log 2024-09-16T07:54:57.635 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63912.log.gz 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47294.log 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44649.log: /var/log/ceph/ceph-client.admin.63116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43865.log 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63116.log.gz 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44649.log.gz 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47294.log: 47.2% -- replaced with /var/log/ceph/ceph-client.admin.47294.log.gz 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53061.log 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43865.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43865.log.gz 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48435.log 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53061.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60532.log 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53061.log.gz 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38856.log 2024-09-16T07:54:57.636 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48435.log.gz 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60532.log: -- /var/log/ceph/ceph-client.admin.64317.log 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60532.log.gz 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41449.log 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38856.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38856.log.gz 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36060.log 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64317.log: /var/log/ceph/ceph-client.admin.41449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61364.log 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64317.log.gz 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41449.log.gz 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36060.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36060.log.gz 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63652.log 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29904.log 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61364.log: gzip/var/log/ceph/ceph-client.admin.63652.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33729.log 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63652.log.gz 2024-09-16T07:54:57.637 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6%/var/log/ceph/ceph-client.admin.29904.log: -- replaced with /var/log/ceph/ceph-client.admin.61364.log.gz 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29904.log.gz 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48524.log 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33729.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33729.log.gz 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55189.log 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48524.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53417.log 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48524.log.gz 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32318.log 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55189.log.gz 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53417.log: -- /var/log/ceph/ceph-client.admin.42026.log 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53417.log.gz 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32318.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60154.log 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32318.log.gz 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32358.log 2024-09-16T07:54:57.638 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42026.log.gz 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65042.log 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60154.log: /var/log/ceph/ceph-client.admin.32358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33511.log 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32358.log.gz 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60154.log.gz 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65042.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65042.log.gz 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45255.log 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38473.log 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33511.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33511.log.gz 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42545.log 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45255.log: /var/log/ceph/ceph-client.admin.38473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34036.log 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% 49.2% -- replaced with /var/log/ceph/ceph-client.admin.38473.log.gz 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45255.log.gz 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42545.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42545.log.gz 2024-09-16T07:54:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66000.log 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34036.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34036.log.gz 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50877.log 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66000.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37773.log 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66000.log.gz 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51582.log 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50877.log.gz 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56806.log 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37773.log: /var/log/ceph/ceph-client.admin.51582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29632.log 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51582.log.gz 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37773.log.gz/var/log/ceph/ceph-client.admin.56806.log: 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56806.log.gz 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55548.log 2024-09-16T07:54:57.640 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.29632.log: -- /var/log/ceph/ceph-client.admin.31829.log 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29632.log.gz 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.55548.log: /var/log/ceph/ceph-client.admin.54556.log 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55548.log.gz/var/log/ceph/ceph-client.admin.31829.log: 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31829.log.gz 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42504.log 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54556.log: 49.6%gzip -5/var/log/ceph/ceph-client.admin.43031.log: --verbose -- /var/log/ceph/ceph-client.admin.30003.log 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54556.log.gz 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44052.log 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42504.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42504.log.gz/var/log/ceph/ceph-client.admin.30003.log: 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32409.log 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30003.log.gz 2024-09-16T07:54:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54495.log 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44052.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44052.log.gz 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36640.log 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32409.log: /var/log/ceph/ceph-client.admin.54495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32094.log 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32409.log.gz 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54495.log.gz 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36640.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36640.log.gz 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59498.log 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66966.log 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32094.log: /var/log/ceph/ceph-client.admin.59498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56746.log 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32094.log.gz 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59498.log.gz 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37339.log 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66966.log.gz 2024-09-16T07:54:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48315.log 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56746.log: /var/log/ceph/ceph-client.admin.37339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56746.log.gz 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37339.log.gz 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30845.log 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48315.log: /var/log/ceph/ceph-client.admin.44006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52183.log 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48315.log.gz 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30845.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30845.log.gz 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46429.log 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52183.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52183.log.gz 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50381.log 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46429.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63692.log 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46429.log.gz 2024-09-16T07:54:57.643 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.52724.log.gz 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50381.log.gz 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52307.log 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63692.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63692.log.gz 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44430.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.64010.log 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52307.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52307.log.gz 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55508.log 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64010.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64010.log.gz 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39457.log 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52356.log 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55508.log.gz 2024-09-16T07:54:57.644 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39457.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39457.log.gz 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.55410.log 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52356.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52356.log.gz 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50332.log 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55410.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29438.log 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55410.log.gz 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38430.log 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50332.log.gz 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44737.log 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29438.log.gz 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38430.log: -- /var/log/ceph/ceph-client.admin.34385.log 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38430.log.gz 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44737.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-09-16T07:54:57.645 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56857.log 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34385.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59225.log 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56857.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56857.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38930.log 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57644.log 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59225.log.gz 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55857.log 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38930.log.gz 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58122.log 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57644.log.gz 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46527.log 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55857.log.gz 2024-09-16T07:54:57.646 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55229.log 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58122.log.gz 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51275.log 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46527.log.gz 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52139.log 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55229.log.gz 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44350.log 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51275.log.gz 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52447.log 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52139.log.gz 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31591.log 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44350.log.gz 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41311.log 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52447.log.gz 2024-09-16T07:54:57.647 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30676.log 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31591.log.gz 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35880.log 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41311.log.gz 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52694.log 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30676.log.gz 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42729.log 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35880.log.gz 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42644.log 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52694.log.gz 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48960.log 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42729.log.gz 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67344.log 2024-09-16T07:54:57.648 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42644.log.gz 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60919.log 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48960.log.gz 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46667.log 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67344.log.gz 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39139.log 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60919.log.gz 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38047.log 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46667.log.gz 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58561.log 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39139.log.gz 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38047.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38047.log.gz 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58212.log 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58561.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58561.log.gz 2024-09-16T07:54:57.649 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63165.log 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58212.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58212.log.gz 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45960.log 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63165.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63165.log.gz 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61188.log 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53199.log 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45960.log.gz 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38794.log 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61188.log.gz 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53199.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53199.log.gz 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.61684.log 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38794.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38794.log.gz 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36970.log 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61684.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61684.log.gz 2024-09-16T07:54:57.650 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66604.log 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36970.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40519.log 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36970.log.gz 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28453.log 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.66604.log.gz 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56261.log 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40519.log.gz 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40256.log 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28453.log.gz 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51662.log 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56261.log.gz 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61438.log 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40256.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40256.log.gz 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42951.log 2024-09-16T07:54:57.651 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51662.log: /var/log/ceph/ceph-client.0.61438.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51662.log.gz 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63205.log 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42951.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42951.log.gz 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42595.log 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63205.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63205.log.gz 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49705.log 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42595.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42595.log.gz 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52921.log 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49705.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49705.log.gz 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67092.log 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52921.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52921.log.gz 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64615.log 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67092.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67092.log.gz 2024-09-16T07:54:57.652 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61139.log 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64615.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64615.log.gz 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54802.log 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61139.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61139.log.gz 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42146.log 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54802.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54802.log.gz 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61048.log 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42146.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42146.log.gz 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45642.log 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61048.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61048.log.gz 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44786.log 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33293.log 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45642.log: /var/log/ceph/ceph-client.admin.44786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64873.log 2024-09-16T07:54:57.653 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45642.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44786.log.gz 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33293.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33293.log.gz 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63325.log 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64873.log: gzip 49.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.33551.log 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64873.log.gz 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55815.log 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63325.log.gz 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33572.log 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33551.log: /var/log/ceph/ceph-client.admin.55815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47335.log 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55815.log.gz 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33551.log.gz 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.33572.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33572.log.gz 2024-09-16T07:54:57.654 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56683.log 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47335.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47335.log.gz 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45355.log 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5/var/log/ceph/ceph-client.admin.56683.log: --verbose -- /var/log/ceph/ceph-client.admin.62400.log 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56683.log.gz/var/log/ceph/ceph-client.admin.45355.log: 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31689.log 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45355.log.gz 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40345.log 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62400.log: /var/log/ceph/ceph-client.admin.31689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63609.log 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62400.log.gz 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31689.log.gz 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30696.log 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40345.log: /var/log/ceph/ceph-client.admin.63609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63067.log 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63609.log.gz 2024-09-16T07:54:57.655 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40345.log.gz 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30696.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30696.log.gz 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30228.log 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63067.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63067.log.gz 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61279.log 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30228.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30228.log.gz 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45464.log 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61279.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61279.log.gz 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50828.log 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45464.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45464.log.gz 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65091.log 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50828.log: 50.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55995.log 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50828.log.gz 2024-09-16T07:54:57.656 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36840.log 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65091.log.gz 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55995.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55995.log.gz 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52781.log 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36840.log: /var/log/ceph/ceph-client.admin.37130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37557.log 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36840.log.gz 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34476.log 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52781.log.gz 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66267.log 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37557.log.gz 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60114.log 2024-09-16T07:54:57.657 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34476.log.gz 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37865.log 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66267.log: /var/log/ceph/ceph-client.admin.60114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64357.log 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60114.log.gz 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66267.log.gz 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37865.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37865.log.gz 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29212.log 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64357.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64357.log.gz 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38972.log 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29212.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29212.log.gz 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35446.log 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39828.log 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38972.log: gzip/var/log/ceph/ceph-client.admin.35446.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51356.log 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35446.log.gz 2024-09-16T07:54:57.658 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38972.log.gz 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39828.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39828.log.gz 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.54305.log 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51356.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51356.log.gz 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37619.log 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54305.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43736.log 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54305.log.gz 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37619.log.gz 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32492.log 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43736.log: /var/log/ceph/ceph-client.admin.48593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45420.log 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43736.log.gz 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39961.log 2024-09-16T07:54:57.659 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32492.log: /var/log/ceph/ceph-client.admin.45420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66924.log 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32492.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45420.log.gz 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39961.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39961.log.gz 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29800.log 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66924.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66924.log.gz 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66437.log 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29800.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29800.log.gz 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58917.log 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66437.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66437.log.gz 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.38514.log 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58917.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58917.log.gz 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2024-09-16T07:54:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38514.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38514.log.gz 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38365.log 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.35090.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56354.log 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28689.log 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.38365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41185.log/var/log/ceph/ceph-client.admin.56354.log: 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56354.log.gz 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38365.log.gz 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28689.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28689.log.gz 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30934.log 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28716.log 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41185.log.gz 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.30934.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30934.log.gz 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50430.log 2024-09-16T07:54:57.661 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.28716.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28716.log.gz 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62480.log 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50430.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50430.log.gz 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63423.log 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62480.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60294.log 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62480.log.gz 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40603.log 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63423.log.gz 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53110.log 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60294.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60294.log.gz 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51057.log 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40603.log: /var/log/ceph/ceph-client.admin.53110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53110.log.gz 2024-09-16T07:54:57.662 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40603.log.gz 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51057.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51057.log.gz 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37419.log 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53604.log 50.0% 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37419.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37419.log.gz 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47205.log 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64150.log 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53604.log: /var/log/ceph/ceph-client.admin.47205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37129.log 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47205.log.gz 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53604.log.gz 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64150.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64150.log.gz 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.57051.log.gz 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32009.log 2024-09-16T07:54:57.663 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40883.log 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.37129.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37129.log.gz 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31471.log 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.32009.log.gz 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29310.log 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40883.log.gz 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31511.log 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31471.log.gz 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.29310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41360.log 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29310.log.gz 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.31511.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49347.log 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31511.log.gz 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41115.log 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41360.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41360.log.gz 2024-09-16T07:54:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49347.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.48355.log 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49347.log.gz 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41115.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41115.log.gz 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56543.log 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45562.log 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48355.log: /var/log/ceph/ceph-client.admin.56543.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48355.log.gz 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.34245.log 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56543.log.gz 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45562.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45562.log.gz 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62669.log 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51533.log 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34245.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34245.log.gz 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62669.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.45066.log 2024-09-16T07:54:57.665 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62669.log.gz 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51533.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51533.log.gz 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53690.log 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61733.log 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45066.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45066.log.gz 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66168.log 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53690.log.gz 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61733.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61733.log.gz 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56585.log 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61237.log 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66168.log.gz 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56585.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56585.log.gz 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.0.34635.log 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34196.log 2024-09-16T07:54:57.666 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61237.log.gz 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.34635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54704.log 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34196.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56494.log 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34196.log.gz 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.54704.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51295.log 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54704.log.gz 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56494.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56494.log.gz 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36151.log 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51295.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51295.log.gz 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32717.log 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.36151.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36151.log.gz 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56164.log 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54354.log 2024-09-16T07:54:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.32717.log: gzip -5/var/log/ceph/ceph-client.admin.56164.log: --verbose -- /var/log/ceph/ceph-client.admin.47770.log 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32717.log.gz 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56164.log.gz 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54354.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54354.log.gz 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60343.log 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47770.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47770.log.gz 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57108.log 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60343.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60343.log.gz 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61953.log 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57108.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57108.log.gz 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55906.log 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61953.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61953.log.gz 2024-09-16T07:54:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55906.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55906.log.gz 2024-09-16T07:54:57.705 INFO:teuthology.orchestra.run.smithi137.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T07:54:57.993 INFO:teuthology.orchestra.run.smithi137.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.34635.log.gz 2024-09-16T07:54:58.014 INFO:teuthology.orchestra.run.smithi137.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.61438.log.gz 2024-09-16T07:55:21.474 INFO:teuthology.orchestra.run.smithi137.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T07:55:22.861 INFO:teuthology.orchestra.run.smithi170.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T07:55:23.344 INFO:teuthology.orchestra.run.smithi137.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T07:55:23.347 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-09-16T07:55:23.347 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m26.689s 2024-09-16T07:55:23.347 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m55.050s 2024-09-16T07:55:23.347 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m2.398s 2024-09-16T07:55:24.332 INFO:teuthology.orchestra.run.smithi170.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T07:55:24.334 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-16T07:55:24.334 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m27.635s 2024-09-16T07:55:24.334 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m51.966s 2024-09-16T07:55:24.334 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m1.798s 2024-09-16T07:55:24.335 INFO:tasks.ceph:Archiving logs... 2024-09-16T07:55:24.335 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867/remote/smithi137/log 2024-09-16T07:55:24.366 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T07:55:33.615 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867/remote/smithi170/log 2024-09-16T07:55:33.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T07:55:42.393 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T07:55:42.402 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T07:55:42.403 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T07:55:42.406 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T07:55:42.501 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T07:55:42.509 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T07:55:42.510 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:55:42.513 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T07:55:42.526 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:55:42.529 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-16T07:55:42.531 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:55:42.531 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-09-16T07:55:42.531 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +1984us[+2038us] +/- 41ms 2024-09-16T07:55:42.531 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -4676us[-4676us] +/- 60ms 2024-09-16T07:55:42.531 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +1994us[+2048us] +/- 62ms 2024-09-16T07:55:42.531 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:55:42.533 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T07:55:42.533 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-16T07:55:42.533 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +1986us[+2014us] +/- 41ms 2024-09-16T07:55:42.533 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -4696us[-4668us] +/- 60ms 2024-09-16T07:55:42.533 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +1992us[+2020us] +/- 62ms 2024-09-16T07:55:42.533 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T07:55:42.534 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T07:55:42.543 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T07:55:42.543 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T07:55:42.551 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T07:55:42.656 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T07:55:42.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:55:42.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:55:42.755 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T07:55:42.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:55:42.785 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T07:55:42.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T07:55:42.802 INFO:teuthology.task.internal:Duration was 1400.896082 seconds 2024-09-16T07:55:42.802 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T07:55:42.811 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T07:55:42.811 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T07:55:42.814 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T07:55:42.852 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:55:42.865 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T07:55:43.146 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T07:55:43.147 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-09-16T07:55:43.147 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T07:55:43.168 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-09-16T07:55:43.168 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T07:55:43.208 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T07:55:43.208 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T07:55:43.210 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T07:55:43.275 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T07:55:43.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T07:55:43.278 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T07:55:43.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T07:55:43.422 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T07:55:43.422 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T07:55:43.447 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T07:55:43.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T07:55:43.482 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:55:43.490 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:55:43.510 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-09-16T07:55:43.536 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-09-16T07:55:43.561 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:55:43.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:55:43.598 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T07:55:43.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T07:55:43.615 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T07:55:43.625 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T07:55:43.626 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867/remote/smithi137 2024-09-16T07:55:43.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T07:55:43.676 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-16_07:15:55-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7906867/remote/smithi170 2024-09-16T07:55:43.676 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T07:55:43.709 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T07:55:43.709 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T07:55:43.713 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T07:55:43.759 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T07:55:43.771 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T07:55:43.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T07:55:43.781 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T07:55:43.781 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T07:55:43.784 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T07:55:43.796 INFO:teuthology.orchestra.run.smithi137.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 07:55 /home/ubuntu/cephtest 2024-09-16T07:55:43.813 INFO:teuthology.orchestra.run.smithi170.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 07:55 /home/ubuntu/cephtest 2024-09-16T07:55:43.814 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T07:55:43.824 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T07:55:43.847 INFO:teuthology.run:Summary data: description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench-high-concurrency} duration: 1400.8960819244385 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-16T07:55:43.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T07:55:43.942 INFO:teuthology.run:pass